-- Logs begin at Thu 2022-02-10 02:55:46 UTC, end at Thu 2022-02-10 03:53:39 UTC. -- Feb 10 03:23:30.228179 dv-cinder-828060-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 10 03:23:30.236089 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 10 03:23:30 2022] *** Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: nodename: dv-cinder-828060-2-iscsi Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: machine: x86_64 Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: clock source: unix Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: pcre jit disabled Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: detected number of CPU cores: 4 Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: current working directory: / Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: detected binary path: /usr/bin/uwsgi-core Feb 10 03:23:30.238092 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: your processes number limit is 47680 Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: your memory page size is 4096 bytes Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: detected max file descriptor number: 2048 Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: lock engine: pthread robust mutexes Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: thunder lock: enabled Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 10 03:23:30.239189 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 10 03:23:30.286518 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: Python main interpreter initialized at 0x5653ce7389c0 Feb 10 03:23:30.286518 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: python threads support enabled Feb 10 03:23:30.286518 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: your server socket listen backlog is limited to 100 connections Feb 10 03:23:30.286518 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: your mercy for graceful operations on workers is 90 seconds Feb 10 03:23:30.287115 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: mapped 403077 bytes (393 KB) for 2 cores Feb 10 03:23:30.287115 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: *** Operational MODE: preforking *** Feb 10 03:23:30.287355 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: *** uWSGI is running in multiple interpreter mode *** Feb 10 03:23:30.287355 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: spawned uWSGI master process (pid: 79133) Feb 10 03:23:30.287589 dv-cinder-828060-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 10 03:23:30.289047 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: spawned uWSGI worker 1 (pid: 79147, cores: 1) Feb 10 03:23:30.289047 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: spawned uWSGI worker 2 (pid: 79148, cores: 1) Feb 10 03:23:30.289047 dv-cinder-828060-2-iscsi devstack@keystone.service[79133]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 10 03:23:36.015199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:23:36.015199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: from cryptography.utils import int_from_bytes Feb 10 03:23:36.016425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:23:36.016425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: from cryptography.utils import int_from_bytes Feb 10 03:23:36.062932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:23:36.063313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:23:36.063553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] command line args: [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:23:36.063934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:23:36.064232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ================================================================================ {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:23:36.064620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] admin_token = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.064998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] config_dir = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.065306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.065625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] config_source = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.065935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] debug = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.066264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_config_append = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.069593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.070406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_dir = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.070406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_file = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.070640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.071339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.071732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.072068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.072421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.072421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.073110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.073457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.073799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.074147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.074550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.074995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.075438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.075888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.076403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.077074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.077394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] publish_errors = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.077764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.078174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.078481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.078949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.079327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.079718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] standard_threads = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.080087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.080459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.080766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.081075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] use_journal = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.081386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] use_json = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.081691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] use_stderr = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.081991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] use_syslog = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.082400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.082874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.083249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.083643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.084027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.084246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:23:36.084246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: from cryptography.utils import int_from_bytes Feb 10 03:23:36.085269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:23:36.085269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: from cryptography.utils import int_from_bytes Feb 10 03:23:36.085651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.085651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.085651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.086270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.086270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.086731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.087069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.087449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.087836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.088208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.088593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.088980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.089351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.089747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.090133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.090514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.091016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.091373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.091765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.092171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.092561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.092925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.093290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.093703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.094078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.094475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.094962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.095327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.095693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.096151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.096548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.096917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.097297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.097666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.098039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.098405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.098808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.099179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.099542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.099906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.100272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.100651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.101021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.101394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.101760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.102357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.102763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.103156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.103531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.103903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.104270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.104635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.104999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.105374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.105738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.106118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.106488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.106911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.107274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.107718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.108092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.108461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.108831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.109194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.109612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.109977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.110359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.110772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.111139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.111504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.111875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.112267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.112629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.112995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.113379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.113744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.114114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.114484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.114883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.115249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.115643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.116013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.116384 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.116753 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.117121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.117483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.117844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.118206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.118569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.118975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.119423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.119765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.120129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.120514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.120882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.121263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.121630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.122020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.122416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.122819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.123190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.external = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.123597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.124050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.124416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.124779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.password = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.125223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] auth.token = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.125597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.125969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.126341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.127079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.127464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.127840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.128199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.128568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.128945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.129326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.129707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.130069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.130439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.130847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.131087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:23:36.131315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:23:36.131538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.131761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] command line args: [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:23:36.131761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:23:36.131761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ================================================================================ {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:23:36.132374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.132595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] admin_token = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.132805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.133033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] config_dir = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.133033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.133033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] config_source = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.133643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.133854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] debug = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.133854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.133854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.134493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.134763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.134763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.135177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.137545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.137545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.138192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.138544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_config_append = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.138544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.138544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_dir = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.139682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.140047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_file = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.140047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.140665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.141003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.141003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.141616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.141962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.141962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.142598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.142999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.142999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.143610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.143879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.143879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.144335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.144600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.144600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.145019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.145286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.145533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.145756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.145756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.146169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.146452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.146752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.146982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.146982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] publish_errors = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.147384 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.147598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.147598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.147598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.148224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.148453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.148666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.148875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.148875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] standard_threads = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.149373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.149585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.149585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.149585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.150195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.150423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] use_journal = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.150423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] use_json = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.150887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.151098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] use_stderr = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.151098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] use_syslog = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.151098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:23:36.151713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.151939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.151939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.152339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.152551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.152551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.152978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.153188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.153188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.153585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.153795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.154122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.154346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.154346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.154800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.155013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.155013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.155427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.155637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.155637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.156979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.157404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.157615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.157615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.158027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.158258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.158497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.158731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.158731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.159132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.159343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.159343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.159880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.160088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.160088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.160504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.160716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.160716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.161122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.161334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.161334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.161749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.162030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.162030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.162740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.162958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.162958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.163372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.163602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.163602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.164843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.165258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.165481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.165481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.165940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.166149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.166149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.166637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.166895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.166895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.167296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.167523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.167523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.167926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.168149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.168149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.168572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.168783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.168783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.169191 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.169435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.169435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.169836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.170048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.170048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.170445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.170715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.170715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.171139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.171362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.171362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.171813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.172047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.172276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.172498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.172498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.172914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.173137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.173137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.173551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.173762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.173762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.174183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.174392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.174392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.174942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.175153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.175153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.175573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.175783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.175783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.176213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.176436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.176436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.176859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.177084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.177084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.177522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.177747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.177747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.178172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.178432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.178801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.179036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.179036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.179459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.179693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.179693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.180132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.180357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.180357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.180798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.181023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.181023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.181480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.181705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.181705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.182128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.182363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.182363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.182894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.183118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.183118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.183543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.183777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.183777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.184220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.184455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.184455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.184890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.185114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.185114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.185565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.185799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.185799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.186225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.186447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.186447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.186920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.187158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.external = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.187158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.187660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.187909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.187909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.188358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.188592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.password = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.188592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] auth.token = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.189933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.190341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.190565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.190919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.191399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.191399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.191846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.192072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.192072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.192508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.192734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.192734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.193164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.193391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.193391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.193829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.194051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.194051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.194500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.194755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.194755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.195215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.195452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.195452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.195888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.196110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.196328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.196565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.196565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.196987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.197228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.197228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.197662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.197898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.197898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.198344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.198567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.198567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.199915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.200368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.200605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.200605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.201042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.201268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.201268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.201688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.201932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.202156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.202378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.202378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.202831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.203055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.203055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.203498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.203733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.203733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.204169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.204389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.204389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.204822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.205044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.205044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.205470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.205691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.205691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.206133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.206373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.206373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.206884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.207105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.207105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.207549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.207772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.207994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.208219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.208219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.208659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.208881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.208881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.209302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.209539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.209539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.209972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.210195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.210195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.210615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.210861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.210861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.211300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.211523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.211523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.211952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.212172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.212172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.212625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.212850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.212850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.213272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.213491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.213491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.213927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.214152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.214152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.214573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] role.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.214843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.214843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.215278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] role.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.215507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.215507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.215917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.216133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.216133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.216555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.216771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.216771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.217178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.217394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.217394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.217819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.218032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.218032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.218460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.218812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.218812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.219259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.219653 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.219896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.220116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.220116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.220525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.220733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.220733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.221142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.221352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.221352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.221868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.222102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.222102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.222524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.222764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.222764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.223207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.223431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.223431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.223845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.224735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.225341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.225559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.225559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.225990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.226211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.226211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.226630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.226872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.226872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.227309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.227544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.227544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.227978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.228196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.228196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.228633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.228852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.228852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.229249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.229472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.229472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.229892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.230106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.230106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.230536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.230773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.230773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.231203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.231422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.231422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.231836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.232063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.232063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.232471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.232687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.232901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.233116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.233116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.233558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.233771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.233771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.234225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.234445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] role.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.234445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] role.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.234907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.235128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.235128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.235546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.235766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.235766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.236197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.236427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.236427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.236829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.237043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.237043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.237465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.237672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.237672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.238077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.238278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.238505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.238761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.238761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.239183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.239408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.239617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.239830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.239830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.240197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.240387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.240387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.240752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.241017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.241017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.241412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.241630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.241630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.242913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.243523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.243737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.243737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.244142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.244357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.244357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.244805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.245027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.245027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.245449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.245671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.245671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.246118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.246343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.246343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.246848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.247076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.247076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.247508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.247739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.247739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.248167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.248390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.248390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.248819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.connection = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.249048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.249048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.249471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.249689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.249689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.250171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.250411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.250411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.250871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.251088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.251317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.251537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.251537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.connection = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.252324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.252565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.252565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.252990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.253213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.253213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.253637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.253858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.253858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.254279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.254492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.254492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.254953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.255176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.255176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.255608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.255825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.255825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.256344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.256564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.256564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.256992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.257215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.257215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.257664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.257882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.257882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:23:36.258943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:23:36.258943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:23:36.259996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.259996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.259996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.259996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.264068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.264426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.264774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.273865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.282070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.282375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.293533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.293895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.336572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.338601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.386132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.386554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.388417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.388788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.454857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.455978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.456114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.456251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.456385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.456385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.456650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.479528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.479768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.480009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.480175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.480375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.480571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.480764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.482089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.482314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.482693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.482975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.483247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.483512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.483787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.492780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.492985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.506555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.506818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.506942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.507927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.508041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.508168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.508168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 10 03:23:36.525646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.525869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 03:23:36.526115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.526256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.526382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 03:23:36.526524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 03:23:36.526803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.526943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 10 03:23:36.527419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.527938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.528240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.537867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.538323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.538585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.538896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.539399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.539926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.540246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.540582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.547012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.549058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.550217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.550498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.550806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.551081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.551352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.551605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.551867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.552132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.552392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.552771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.552969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.553179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.553376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.553722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.554052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.554382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.554782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.555105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.555431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.555751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.556189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.556512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.578833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.580349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.580708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.583099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.584803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.585176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.586000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.586279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.586549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.591277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.591713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.592250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.593668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.593949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.598324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.598598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.598900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.599177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.599447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.599714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.600102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.600366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.601431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.601863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.606423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.606975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.607395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.607827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.608238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.608648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.609251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.609712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.618568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.618879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.623496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.627503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.627789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.632674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.636217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.639763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.640941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.642922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.649749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.656906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.657517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.661611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.661899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.662160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.662416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.667544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.670684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.671976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.672252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.674610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.675272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.675518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.675829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.676107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.676361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.681450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.681919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.682359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.685198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.685198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.685198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.689723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.690025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.690300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.690534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.690863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.691150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.691415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.708804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.712112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.715325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.716869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.718419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.718771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.719051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.722784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.723298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.723756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.724219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.726082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.727779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.730908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.731190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.731468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.731823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.739573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.740633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.740927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.741205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.742798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.743257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.748916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.749068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.749213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.749471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.749572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.749745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.750870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.751042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.751180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.751422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.752051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.752295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.752577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.752797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.777836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.778243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.778772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.779259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.779743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.780208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.780714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.789628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653ce7389c0 pid: 79147 (default app) Feb 10 03:23:36.793027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348833d2-42a1-4bf0-8dd5-4213759b77ee None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:36.793288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348833d2-42a1-4bf0-8dd5-4213759b77ee None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:36.793591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348833d2-42a1-4bf0-8dd5-4213759b77ee None None] PATH_INFO: `/v3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:36.800299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Thu Feb 10 03:23:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:36.816250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.822631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.828998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.832081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.835066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.835548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.836036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.850234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.855386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.861573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.862073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.862557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.863103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.881007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:36.881539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:36.882003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.023209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 10 03:23:37.024086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.024086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.024086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.024358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.024747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.024882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.025109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.025325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.025588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.025853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.026116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.026365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.026639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 10 03:23:37.064817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5653ce7389c0 pid: 79148 (default app) Feb 10 03:23:45.248793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:45.249351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:45.249351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:45.251610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:45.259925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:45.260363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:45.260480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:45.291207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG oslo_db.sqlalchemy.engines [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:23:45.477819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG passlib.handlers.bcrypt [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79148) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 03:23:45.478248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG passlib.handlers.bcrypt [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79148) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 03:23:45.534923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:45.536431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:45.666201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1/3] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:45.823031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:45.858690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG oslo_db.sqlalchemy.engines [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:23:46.096400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1c94-35d6-4b8d-b893-d3b38cad4f58 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:46.101721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:46.102398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:46.102677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:46.102961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:46.113780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:46.167517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 03:23:46.167855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbfd9f-564b-425d-b993-1dcd387190ad admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:46.179983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:23:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:23:46.187117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:46.210893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d97448-83f0-4fcd-a6f5-fc64fa4f0cb8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:46.216230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:46.217359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:46.217646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:46.217923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] PATH_INFO: `/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:46.219673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] RBAC: Authorizing `identity:get_project(project_id=8de7cdc6a1fd4e2da360f0670fd57a70)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:46.270739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 10 03:23:46.271385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b5c6-42dc-48fd-8e9e-8da3b8a7f639 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:46.275820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 2/5] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:23:46 2022] GET /identity/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:48.453109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed60aa-112e-4c48-8e17-cbc123b0879f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:48.453675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed60aa-112e-4c48-8e17-cbc123b0879f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:48.453675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed60aa-112e-4c48-8e17-cbc123b0879f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:48.458450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 4/6] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:48.464416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:48.464847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:48.464933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:48.484579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:48.486095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:48.494454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 3/7] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:48.519331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed60aa-112e-4c48-8e17-cbc123b0879f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:48.532668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed60aa-112e-4c48-8e17-cbc123b0879f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:48.537615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:48.538260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:48.538540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:48.538849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:48.546827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:48.548626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc74a0-411f-4c16-9ae6-a236f54ae8fc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:48.557463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:23:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:23:48.563390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:48.572853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726af95-a30e-4ef8-a25d-822cf8a4ac0c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:48.578741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:48.579608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:48.579879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:48.580144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:48.581693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:48.583587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb2935-ab51-49a4-ae7b-2e5597789dfd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:48.585141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 4/9] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:23:48 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:50.850071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c305-d25f-49a8-8908-713c43431204 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.850606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c305-d25f-49a8-8908-713c43431204 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.850606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c305-d25f-49a8-8908-713c43431204 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.852612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:23:50.857970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c22dd-7fa4-47a3-8446-fd3200371c0c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.858391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c22dd-7fa4-47a3-8446-fd3200371c0c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.858531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c22dd-7fa4-47a3-8446-fd3200371c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.877386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2a3c22dd-7fa4-47a3-8446-fd3200371c0c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:50.878555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2a3c22dd-7fa4-47a3-8446-fd3200371c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:50.886702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 5/11] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:50.893662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60d7a-9ead-422c-a8ad-60cc35a1192a None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.893946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60d7a-9ead-422c-a8ad-60cc35a1192a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.894217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60d7a-9ead-422c-a8ad-60cc35a1192a None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.896264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 7/12] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:23:50.901360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.901644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.901917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.910147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60d7a-9ead-422c-a8ad-60cc35a1192a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:50.920410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:50.921748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:50.923088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60d7a-9ead-422c-a8ad-60cc35a1192a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:50.927901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:50.928716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.928999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.929272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.929904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 6/13] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:50.948502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:23:50.952921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:50.955832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:23:50.957133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 8/14] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:23:50.962383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec3b6b-b9ba-4af7-93f0-dea260540a65 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:50.963542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:50.967064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:50.967720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.968005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.968282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.973761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc460a-0c97-4e84-842f-4febb59be87f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:50.976602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:50.978168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:50.978395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:50.978869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:50.979155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:50.979436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:50.980218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:50.980519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:50.982312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:50.982312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:23:50.982312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:23:50.983259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:50.987429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 7/15] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:23:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:23:50.993210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:50.997895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 9/16] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:51.002493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae1810-c06f-4372-9572-419a4b3a4bdd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:51.004189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:51.007482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:51.008280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:51.008562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:51.008834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:51.010074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:51.011837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:51.013417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 8/17] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:23:51.014241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990583-a889-4ea3-a882-83603ec5f38d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:51.019002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:51.019909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:51.020193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:51.020465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:51.022355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:51.024307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:51.026097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:23:51 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:51.032513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:51.042701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e16a-7fa7-4f99-9236-4feefe06b6c2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:51.047417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:51.048233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:51.048513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:51.048909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:51.050045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:51.051853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98560403-3730-42f0-8098-5ecdd1560bd0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:51.054094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:51.060196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:51.071716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee396dd-121d-4025-84d0-ff464ee6e9fd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:51.078094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:51.078843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:51.079128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:51.079405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:51.080336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.domain.id=default, user.id=203b86d4b17b44b7b8c725bbce8d9578) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:51.080652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:51.081740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:51.081740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:23:51.081740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:23:51.083190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2991-ad5c-4bea-8e38-9135b8ef53f0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:51.094205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1343 bytes} [Thu Feb 10 03:23:51 2022] GET /identity/v3/role_assignments?user.id=203b86d4b17b44b7b8c725bbce8d9578&scope.domain.id=default&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 233 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:53.779032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b0caf-461f-4f33-89b5-26ab24ecf27e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:53.780119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b0caf-461f-4f33-89b5-26ab24ecf27e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:53.780608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b0caf-461f-4f33-89b5-26ab24ecf27e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:53.783495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:53.789186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:53.790170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:53.790645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:53.839610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG passlib.handlers.bcrypt [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79147) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 10 03:23:53.840391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG passlib.handlers.bcrypt [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79147) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 10 03:23:53.888010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:53.890226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-df15172b-f608-4a9d-a2a2-1061bde76399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:53.918422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 12/22] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:53.954059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b0caf-461f-4f33-89b5-26ab24ecf27e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:53.967246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b0caf-461f-4f33-89b5-26ab24ecf27e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:53.972337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:53.973552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:53.974037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:53.974506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:53.987393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:53.989938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.009728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:23:54.011892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 11/23] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:23:54.017626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419710e8-1a86-4f53-b9b3-6a4879b3d8b8 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.018088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419710e8-1a86-4f53-b9b3-6a4879b3d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.018189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419710e8-1a86-4f53-b9b3-6a4879b3d8b8 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.019401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.020454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:54.026193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.026476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.026816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.031321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c928c-36b7-46d4-b15c-e282fa5d57ee admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.043093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.044128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.044608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.045073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.046050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:54.046601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.048641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:54.048641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:23:54.048641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:23:54.048847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:54.049953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:54.050225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.070264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 12/25] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:54.070551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 14/26] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:54.075641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.088060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b747d-4376-48ca-94ca-0f1c3e955414 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.098949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.099638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.099922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.100204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.101183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.102263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:54.102263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:23:54.102263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:23:54.103520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c20ce-182f-40a6-a1d8-f6b7dc35d6e3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.141991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.163770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358281b3-656f-48e3-93ad-a3a091f31faa admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.173536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.174615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.175129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.175624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.176612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.177855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:54.177855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:23:54.177855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:23:54.179173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d25882-6d18-4014-beef-a4d4f7b606ae admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.315197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 15/27] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:23:54.317064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb361e-8008-4e44-8384-c50a7e074e86 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.317352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb361e-8008-4e44-8384-c50a7e074e86 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.317632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb361e-8008-4e44-8384-c50a7e074e86 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.320498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 16/28] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:54.326772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a608-d3d1-4034-9d83-7db62a49356c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.327070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a608-d3d1-4034-9d83-7db62a49356c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.327331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a608-d3d1-4034-9d83-7db62a49356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.344290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 13/29] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/roles => generated 219 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:23:54.363966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3284a608-d3d1-4034-9d83-7db62a49356c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:54.366079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3284a608-d3d1-4034-9d83-7db62a49356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:54.469160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 17/30] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:54.488830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0ebf-497e-4652-95cb-524d1e79fae1 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.489494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0ebf-497e-4652-95cb-524d1e79fae1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.489972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0ebf-497e-4652-95cb-524d1e79fae1 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.492139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 14/31] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:54.502245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.502807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.503329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.515155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0ebf-497e-4652-95cb-524d1e79fae1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.544610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0ebf-497e-4652-95cb-524d1e79fae1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.555982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:54.557956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.558185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:54.559251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.559777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.560251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.590102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:23:54.591240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 18/32] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:54.606378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:23:54.608460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 15/33] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:23:54.614900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.630264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.643736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006278e9-b55f-44f9-a02f-3680b8d1553e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.645697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba5dc-525a-4c2e-a2ac-a02b7be2c25d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.660422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.661234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.661739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.662241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.662476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.662941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.663054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.663485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.664265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.665118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:54.665679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.666814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.669540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.684135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 19/34] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:54.692840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 16/35] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:23:54 2022] POST /identity/v3/roles => generated 225 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:23:54.694189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.705354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead00c-6f41-4084-8705-07768a4222e0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.712846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.714183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.714747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.715301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.717364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.719730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.722002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 20/36] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:23:54 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:54.728028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.740564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278745-6b98-4c48-a26c-ff164d587ca4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.747415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.748433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.748774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.749048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.750780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.753152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1544d4-bb3e-49ea-b3e6-caef40219a90 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.755187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 17/37] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:54.761338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:54.777618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee05b-d83d-4c42-a445-c18300a69f8b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:54.782709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:54.783711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:54.784085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:54.784458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] PATH_INFO: `/v3/domains/default/users/203b86d4b17b44b7b8c725bbce8d9578/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:54.786856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=203b86d4b17b44b7b8c725bbce8d9578, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:54.788017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:54.788017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:23:54.788017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:23:54.790173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e5c51-3aa6-4a41-abfb-18c531e57c6c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:54.816087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 21/38] 10.222.0.32 () {58 vars in 1382 bytes} [Thu Feb 10 03:23:54 2022] PUT /identity/v3/domains/default/users/203b86d4b17b44b7b8c725bbce8d9578/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:23:55.999329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531498-f921-46c5-b1ff-f0e83190cdb3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:55.999923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531498-f921-46c5-b1ff-f0e83190cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.000205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531498-f921-46c5-b1ff-f0e83190cdb3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.000300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47500-cd4a-4f00-9241-aa5d8fa78f1f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.000718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47500-cd4a-4f00-9241-aa5d8fa78f1f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.001067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47500-cd4a-4f00-9241-aa5d8fa78f1f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.003660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 18/39] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:56.004833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 22/40] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:23:56.010290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.010772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.011217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.011962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.012414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.012868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.038413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:56.040029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:56.040287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:56.041661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:56.109351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 19/41] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:56.116168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 23/42] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:56.133170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:56.141430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:56.142878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904417c7-7d68-4bba-a014-9c54a1c79dfb None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:56.147605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:56.148427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.148708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.148969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.150244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:56.152029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:56.153152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6943c-cf52-4c7d-ae41-431dde069a05 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:56.153840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 20/43] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:23:56.159318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:56.159497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:56.160527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.161129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.161781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.163361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:56.164774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:56.164774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:23:56.164774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:23:56.166329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f0f8-e15d-4701-a6ba-5f960d3448a1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:56.169810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865824f8-93a7-4f2a-aa24-685c1abd4c29 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:56.175519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:56.176188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:56.176531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:56.176745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:56.177654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:56.178754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:56.178754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:23:56.178754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:23:56.179991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1e258-0247-4b20-bb33-637c013ade27 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:56.186707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 24/44] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:23:56 2022] POST /identity/v3/roles => generated 223 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:23:56.214497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 21/45] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:23:56 2022] POST /identity/v3/projects => generated 312 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:23:58.094210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe93e3-5c0c-44a3-b490-49ea734b8dfd None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.095026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe93e3-5c0c-44a3-b490-49ea734b8dfd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.095026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe93e3-5c0c-44a3-b490-49ea734b8dfd None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.097183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 25/46] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:23:58.103532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.104292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.104429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.124855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:58.126142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:58.184026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 22/47] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:58.207303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe93e3-5c0c-44a3-b490-49ea734b8dfd None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.219982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe93e3-5c0c-44a3-b490-49ea734b8dfd None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.224361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.225154 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.225436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.225711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.237337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:23:58.244562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:23:58.246133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 26/48] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:23:58.252545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.262593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263d8a5-ea34-433e-8099-5bf050aa1537 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.268135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.268831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.269107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.269381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.270160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:58.270465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.271570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:23:58.271570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:23:58.271570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:23:58.272503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.286524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 23/49] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:58.292559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.305058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6703-d25f-40c9-8c8c-74a458cf3500 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.309523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.310409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.310718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.310991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.312221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.314121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.315928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 27/50] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:58.321429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.331450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1055d-7120-4f82-9bc4-6c006e0015ca admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.335929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.336731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.337009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.337279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.338464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.340220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55d8b-416e-4b56-a8eb-58096d9dadd5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.341811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 24/51] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:58.347984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.357954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c40c9-28b9-47bf-b8a9-91137949422b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.362626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.363303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.363597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.363869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.364718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.domain.id=default, user.id=203b86d4b17b44b7b8c725bbce8d9578) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:23:58.365031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.366964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b56da6-1c33-4dc3-aa4e-496870055cf1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.373682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 28/52] 10.222.0.32 () {56 vars in 1343 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/role_assignments?user.id=203b86d4b17b44b7b8c725bbce8d9578&scope.domain.id=default&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:23:58.540443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813ab2-d47b-4921-8c04-6df1e6dec514 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.540730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813ab2-d47b-4921-8c04-6df1e6dec514 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.541010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813ab2-d47b-4921-8c04-6df1e6dec514 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.542975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 25/53] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:23:58.549221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.549504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.549783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.569402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:23:58.570678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:23:58.578863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 29/54] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:23:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:23:58.602466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44813ab2-d47b-4921-8c04-6df1e6dec514 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.615842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44813ab2-d47b-4921-8c04-6df1e6dec514 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.620541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.621364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.621644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.621916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.623252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.625090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7da4f-ef2f-4ab1-a829-7e38afeede6f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.627160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 26/55] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:23:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:23:58.633175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:23:58.642954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fddb9f-c376-49fd-b4c9-921af59192c9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:23:58.648037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:23:58.648723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:23:58.649014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:23:58.649289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:23:58.650029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:23:58.652035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd60fd0-3eea-40e9-83f4-2e643ced1efb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:23:58.680538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 30/56] 10.222.0.32 () {60 vars in 1161 bytes} [Thu Feb 10 03:23:58 2022] POST /identity/v3/projects => generated 298 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:00.882763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f569-e15d-43d1-a7c4-6c1bc2600f2b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:00.883362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f569-e15d-43d1-a7c4-6c1bc2600f2b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:00.883362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f569-e15d-43d1-a7c4-6c1bc2600f2b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:00.885074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 27/57] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:00.890442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:00.890875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:00.891031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:00.910143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:00.911388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:00.970465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 31/58] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:00.994900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4f569-e15d-43d1-a7c4-6c1bc2600f2b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:01.009145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4f569-e15d-43d1-a7c4-6c1bc2600f2b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:01.014266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:01.015122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:01.015403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:01.015670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:01.016920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:01.018635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8cd77-9677-4260-87ee-fd4d80351cb7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:01.020218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 28/59] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:01.025686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:01.035489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661feef-a34f-4e91-aa55-4f96b56c0b92 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:01.041398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:01.042080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:01.042362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:01.042630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:01.043403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:01.044452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:01.044452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:24:01.044452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:24:01.045706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189fe71-b8c1-42eb-bfc6-dd224c4b703e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:01.074989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 32/60] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:01 2022] POST /identity/v3/users => generated 275 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:04.497664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f68f7-b7cf-4daf-97c9-a68fcf3c3025 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.498302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f68f7-b7cf-4daf-97c9-a68fcf3c3025 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.498742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f68f7-b7cf-4daf-97c9-a68fcf3c3025 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.503332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 29/61] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:04.513337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.514814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.515633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.560381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:04.562999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:04.579781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 33/62] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:04.616168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f68f7-b7cf-4daf-97c9-a68fcf3c3025 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.639351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f68f7-b7cf-4daf-97c9-a68fcf3c3025 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.644555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.645685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.646184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.646667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.666110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:04.675391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:04.675391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 30/63] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:04.684372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.700014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ff25-1f5e-4eea-8e2b-4613fe1ecda5 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.711421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.712133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.712424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.712704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.713508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:04.713824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:04.715539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765a8bc-fc79-4b35-a128-25cf79915df5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:04.731375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 34/64] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:04.739042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.753984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c902f5-a8ca-4b13-9491-42a43c0eaaf9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.763028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.763951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.764233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.764508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.767357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1dbe6-0892-4b9d-97ba-8ed752007dd5 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.767957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1dbe6-0892-4b9d-97ba-8ed752007dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.768445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1dbe6-0892-4b9d-97ba-8ed752007dd5 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.770502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 35/65] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:04.785478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8ec-b79a-45a1-9be7-7674292005e9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.785661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:04.786194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8ec-b79a-45a1-9be7-7674292005e9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.786719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1b8ec-b79a-45a1-9be7-7674292005e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.787814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:04.789849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 31/66] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:04.800947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.829189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4067ca5-f219-4e75-9663-b6e17f96d868 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.835108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a9c1b8ec-b79a-45a1-9be7-7674292005e9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:04.837089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a9c1b8ec-b79a-45a1-9be7-7674292005e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:04.848760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.849867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.850349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.850860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.868346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 36/67] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:04.874460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:04.878463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:04.894687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159024-1247-44ab-b1f1-9e316a189253 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.896049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159024-1247-44ab-b1f1-9e316a189253 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.896856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159024-1247-44ab-b1f1-9e316a189253 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.898034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 32/68] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:04.898737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.907246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 37/69] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:04.911672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159024-1247-44ab-b1f1-9e316a189253 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.912223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052613-6701-489f-9ebd-b04f9597a0a1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.917174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.918123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.918402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.918716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.930949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:04.935745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159024-1247-44ab-b1f1-9e316a189253 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:04.938709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a3f28c81-85cb-4cf1-8800-05d3e0c9b5d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:04.940365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 33/70] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:04.943607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.944733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.945524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.950402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:04.952301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:04.953136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:04.953877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:04.956348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:04.960887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:04.964924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 38/71] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:04.966606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:04.967200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:04.968683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:04.977440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 34/72] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:04.985950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.001365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20e06-e7b2-4fd7-90cb-3c84b5ba0108 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.008477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacbad5-7ff0-4037-bbbf-983e5c4b7582 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.015088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.015690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.016235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.016731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.017059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.017231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.017688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.018147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.018877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.019456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.019625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.020162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.021543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:05.021543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:05.021543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:05.022361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.023780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.034133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 39/73] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.035334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.037062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 35/74] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:04 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=9af319ef09aa4cd69445115653b41037 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:05.044782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.046522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a15a-e227-4add-9827-9244e13f7964 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.051756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.052871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.053367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.053842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.066048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:05.072902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197f02-dbb7-49f7-bb76-d3c6b44a4a3d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.073820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:05.075298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 40/75] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:05.080334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.081610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.082082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.082554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.084318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.086388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.095876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.098063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 36/76] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:05.104316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.107713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff4ee-e3bc-437d-9825-d3fa164476fa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.122284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4c4e-e453-41b1-955d-e80653e3f43a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.123293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.124089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.124452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.124735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.125593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.125905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.129869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.135270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.137329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.137658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.137977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.150621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 41/77] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:05.158637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.160578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.172782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.184790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 37/78] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:05.185315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.191857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096bec-1725-4afa-89f4-81cc01cd65cc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.204064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94c47c-2a71-4ae2-a53b-3404d5c553a6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.204863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.205905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.206216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.206499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.207986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.211208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.213891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 42/79] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:05.223367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.227979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.228875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.229154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.229427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.233042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.235258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7702b-9d13-4449-a558-39d196510847 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.237299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 38/80] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.245899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06730d4-81f3-415e-a58c-d1d7655505d4 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.246293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06730d4-81f3-415e-a58c-d1d7655505d4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.246504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06730d4-81f3-415e-a58c-d1d7655505d4 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.246630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e0a78-f2b4-4175-8bf5-02d1bc469d39 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.248810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 39/81] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:05.249299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06730d4-81f3-415e-a58c-d1d7655505d4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.252326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.253259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.253720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.254211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.264324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.266201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45469-5d79-41b2-b8c9-7e1bb20f4d98 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.268850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06730d4-81f3-415e-a58c-d1d7655505d4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.273566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.274241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.274514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.274822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.275684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.275993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.276394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 43/82] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:05.277731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfff31-983b-4f64-9442-99e870763b02 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.277903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4fc1-a2ad-43dc-87c3-65a3888471af admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.278182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfff31-983b-4f64-9442-99e870763b02 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.278287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfff31-983b-4f64-9442-99e870763b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.287638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 40/83] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=8eff1ce623524530832effb4e96fb820 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.289009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22cb3a-62d6-415d-b029-318aef2acf76 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.289308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22cb3a-62d6-415d-b029-318aef2acf76 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.289562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22cb3a-62d6-415d-b029-318aef2acf76 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.291572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 41/84] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:05.292078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22cb3a-62d6-415d-b029-318aef2acf76 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.310501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22cb3a-62d6-415d-b029-318aef2acf76 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.310786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b3dfff31-983b-4f64-9442-99e870763b02 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:05.312039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b3dfff31-983b-4f64-9442-99e870763b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:05.315831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.316831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.317182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.317423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.318913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.320982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 44/85] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:05.322492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.322838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.323130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.327193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.330164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 42/86] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.343851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.344366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:05.345646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:05.363144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 45/87] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:05.364425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.367265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acd91-471e-4842-9c8e-b6cbe16ab34c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.381343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905dee-71bb-48da-9507-b91096ee515c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.383108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.383792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.384086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.384349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.385198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=203b86d4b17b44b7b8c725bbce8d9578) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.385503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.387674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.395764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 43/88] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/role_assignments?user.id=203b86d4b17b44b7b8c725bbce8d9578&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.401578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.401813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.401813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.401813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.401813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.418701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c584-3d40-4927-befb-e15e0b5d7e1c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.422488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:05.430015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:05.431009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.431604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 46/89] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:05.433464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.433768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.434739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.437361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.441189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.441604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.450803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 44/90] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.461167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.466691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dddc4-af29-41ea-a0b1-0ad608277b0f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.472585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc52c-fca0-4201-8f17-9238447459f9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.482683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.482969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.483107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.483107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.483336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.483467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.483576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.483576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.483858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.483858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.484078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.484078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:05.484078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:05.484078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:05.484472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.484581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.494685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 47/91] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.499893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.513779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369946fd-597c-41f6-9efc-c77f11aa8963 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.518786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.519818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.522681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.522681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.523158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.525744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.530686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 48/92] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.531106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 45/93] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:05 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:24:05.538695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.553922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d235-a9c7-4280-b176-7e480eaef505 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.570695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.574695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.574695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.574695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.598711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.598711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.630698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 49/94] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:05.644022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.666694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900be18-2467-45b8-ac9d-afbb2846b033 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.682711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.682711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.682711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.682711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] PATH_INFO: `/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.686570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=afb9c1f0e55f497b8133fbbbfb810f7c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.693092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912f4dd-4836-4fdc-8cd1-7b70f3980eb8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.703258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 46/95] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c => generated 312 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:05.713912 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:05.742491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e5aa-f64b-4cde-afe1-3f5d808fd59d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:05.753971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:05.754667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:05.754979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:05.755252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:05.756112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=afb9c1f0e55f497b8133fbbbfb810f7c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:05.756424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:05.758343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b14ea-6c09-4a0a-9bee-624ad93e1410 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:05.775169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 50/96] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:05 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=afb9c1f0e55f497b8133fbbbfb810f7c&role.id=9af319ef09aa4cd69445115653b41037 => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:08.363456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704aeaa-0892-452b-b451-d0bf1f06d8b0 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.364286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704aeaa-0892-452b-b451-d0bf1f06d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.364286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704aeaa-0892-452b-b451-d0bf1f06d8b0 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.366107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 47/97] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:08.384770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.385527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.385527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.432897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:08.435041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:08.449238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 51/98] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:08.524080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704aeaa-0892-452b-b451-d0bf1f06d8b0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:08.555740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704aeaa-0892-452b-b451-d0bf1f06d8b0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:08.563090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:08.564471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.564970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.565450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.596396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:08.610223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:08.616688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 48/99] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:08.625557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:08.642454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3212d4-a2cf-49cb-80a9-ef55db0825d1 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:08.650954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:08.652042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.652517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.652982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.653960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:08.654483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:08.656436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:08.692781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 52/100] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:08.701952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:08.727232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06ebe-c635-422d-ac46-213036f542a6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:08.740460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:08.741829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.742254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.742692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.748123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:08.752455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:08.755467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 49/101] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:08 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:08.764299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:08.787934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7dd2-5270-4bb6-b076-7bcc5808a364 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:08.801846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:08.804057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.804885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.805660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.812419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:08.817493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1e34b-e35c-4bf4-853c-0f34d38461a5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:08.822408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 53/102] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:08 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:08.830789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:08.855133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773f83-ee74-4bec-bebf-c1bb00cb0a32 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:08.868336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:08.870217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:08.870935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:08.871606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:08.880169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, user_id=5707e260eb2943eebfe40a32c3e5b3da, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:08.882352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:08.882352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:08.882352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:08.886428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952c927-5e8c-4c8c-ba51-efaf8cf7de08 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:08.926529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 50/103] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:08 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:09.272569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe22ba-99ba-4268-a720-eabc67a15b6b None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.272984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe22ba-99ba-4268-a720-eabc67a15b6b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.273563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe22ba-99ba-4268-a720-eabc67a15b6b None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.277529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 54/104] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:09.287319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.287799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.288289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.321757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6a69-985f-434d-b98e-e22f3c2baa2c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.322197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6a69-985f-434d-b98e-e22f3c2baa2c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.322619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6a69-985f-434d-b98e-e22f3c2baa2c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.326214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 55/105] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:09.333388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.333820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.334279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.343923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:09.345888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:09.385169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:09.387274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:09.438800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 51/106] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:09.481776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 56/107] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:09.502311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.508998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.524048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87534a17-410b-4b02-ba46-14aa0c876399 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.524317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edc16d-9b2e-490f-9b4b-6700ceafbb0a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.535287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.536464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.536930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.537408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.540814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.541722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.542052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.542330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.562123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:09.562315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:09.569425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:09.570331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:09.579031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:09.580880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 57/109] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:09.587146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.589679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.604301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11e63-4b07-4b5f-97ed-912d20141303 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.613538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65a25-0826-4d41-bfeb-f70d346d2456 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.615509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.616438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.616913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.617369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.618350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:09.618896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.621057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.638213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 58/110] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:09.639772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.641111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.641732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.642289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.645448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:09.646056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.648092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.649456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.674468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56bed-559a-48ef-8781-b5156789f364 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.686429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 53/111] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:09.698684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.698684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.698684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.698684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.701807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.706214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.712474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.717012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 59/112] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:09.726766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.738985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3066d-ceb8-4d30-8139-eb6dbfcf9780 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.753588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ebfd9-4e9d-47a4-91eb-2725b43150f9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.763117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.764778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.765343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.765852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.767906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.769407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.769860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.770325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.772059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.775776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.775946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.780105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.783539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 60/113] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:09.787038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 54/114] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:09.792062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.793747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.819069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479128-3185-4083-b0fa-c23124b68516 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.831152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530040a-c8d8-4fff-ad3d-1a4399cb1a03 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.833944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.835507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.836012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.836501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.842459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.846697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.855207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 61/115] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:09 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:09.855858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.857501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.858165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.858505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.859854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:09.869035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, user_id=5707e260eb2943eebfe40a32c3e5b3da, role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.874608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71272451-40de-4a53-b60f-cd60122533e4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.886633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aefc2b-cea6-4b02-8e4b-0911cfe1f70b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:09.901413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:09.903083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:09.903687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:09.904243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/203b86d4b17b44b7b8c725bbce8d9578/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:09.912199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, user_id=203b86d4b17b44b7b8c725bbce8d9578, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:09.918917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae56fb7-bee5-4561-9319-218e547dafe3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:09.938626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 55/116] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:09 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/8eff1ce623524530832effb4e96fb820 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:09.966885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 62/117] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:09 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/203b86d4b17b44b7b8c725bbce8d9578/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:10.270816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1956-e451-4251-b94b-74a61240edb6 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.271321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1956-e451-4251-b94b-74a61240edb6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.271822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1956-e451-4251-b94b-74a61240edb6 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.275552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 56/118] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:10.287120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.287614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.288120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.323805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:10.325706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:10.335877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac3d85-3306-4ebb-abf6-bb45015a4960 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.336294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac3d85-3306-4ebb-abf6-bb45015a4960 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.336736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac3d85-3306-4ebb-abf6-bb45015a4960 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.339781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 57/119] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:10.351343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.351788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.352226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.409572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:10.411699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:10.541294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 63/120] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:10.598964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 58/121] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:10.638698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.656004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078298-e95f-4e2d-8e2d-af2d46126d5f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:10.664181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:10.666135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.666902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.667645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.676481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.704118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70718224-c9b6-4363-b0d7-4a73a9b3253a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:10.712198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:10.714041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.714871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.715698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.739474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:10.755300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:10.765265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:10.773326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-558d51d6-77c2-48b4-a64e-569eac0fced8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:10.775916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 59/122] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:10.777077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 64/123] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:10.779240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e91f1-dd53-4082-8445-241b02dd81ff None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.780025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e91f1-dd53-4082-8445-241b02dd81ff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.780940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e91f1-dd53-4082-8445-241b02dd81ff None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.784591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 60/124] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:10.785655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.792696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e91f1-dd53-4082-8445-241b02dd81ff None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.808048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449eb8-65c2-47e6-b02b-ad451dc324e0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:10.829145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:10.830304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.830872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.831373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.832856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:10.833425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:10.836728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e54d1-ee4e-4e6b-9854-1a4d616c5430 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:10.841545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e91f1-dd53-4082-8445-241b02dd81ff None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:10.857761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:10.859171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.859681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.860176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.861663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:10.862234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:10.865578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:10.883191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 65/125] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:10.885703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910122-0407-40de-9c01-c194dd641504 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.886205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910122-0407-40de-9c01-c194dd641504 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.886720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910122-0407-40de-9c01-c194dd641504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.902627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 61/126] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:10.904123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.927131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bc910122-0407-40de-9c01-c194dd641504 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:10.929283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bc910122-0407-40de-9c01-c194dd641504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:10.935748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904297-ee82-40e4-ba21-6fb96e7ed538 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:10.951482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:10.953095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:10.953574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:10.954059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] PATH_INFO: `/v3/users/59cd2e1fa2d34c63838a3a5df743541a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:10.958412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 66/127] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:10.959878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910122-0407-40de-9c01-c194dd641504 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:10.993737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910122-0407-40de-9c01-c194dd641504 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.000067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=59cd2e1fa2d34c63838a3a5df743541a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.004695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.007836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 62/128] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/users/59cd2e1fa2d34c63838a3a5df743541a => generated 289 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.019184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.020699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.021187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.021667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.024393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.026223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.030218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.033401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 67/129] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:10 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.047750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.064665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94714-43dd-46dd-9e11-b0c53935cbf4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.078918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f22c1-dd34-4ff3-9b35-2f016f8ebc6b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.081005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.082087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.082575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.083084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.099727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.101133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.101600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.102070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] PATH_INFO: `/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.106341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] RBAC: Authorizing `identity:get_project(project_id=afb9c1f0e55f497b8133fbbbfb810f7c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.110462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.113770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 68/130] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:11 2022] GET /identity/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c => generated 312 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.115290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.116748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.120294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.148282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 63/131] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:11.150131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.154713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12682ae-dc4b-49ab-8171-9bcc016dc716 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.162341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.163796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.164328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.164787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.166847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.170415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.173643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 69/132] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.175209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.176538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80529-cd63-4728-91b9-cf355e700d30 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.195417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5648f1-9a5c-4d41-af09-16998f24a901 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.199002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.200610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.201113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.201616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] PATH_INFO: `/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.206279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb9c1f0e55f497b8133fbbbfb810f7c, user_id=5707e260eb2943eebfe40a32c3e5b3da, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.211563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.220265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.221736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.222238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.222766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.225733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.229817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.232980 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 70/133] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:11 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.234385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.269197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 64/134] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:11 2022] PUT /identity/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c/users/5707e260eb2943eebfe40a32c3e5b3da/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:11.274992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:11.276768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605b8e-17f1-4824-8b92-8fbde00e37e2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.476968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.482689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.482689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.482689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.482689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.484382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd23f18-dbfb-412d-a15b-be1197cbad53 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.503733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d87c3c-995e-4b70-9bae-5091efaa84e4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:11.524867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:11.525962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:11.526487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:11.526993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:11.528515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=59cd2e1fa2d34c63838a3a5df743541a) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:11.529120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:11.531593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb01cd-7a59-4791-936e-f652b0634e18 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:11.559768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 65/135] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:11 2022] GET /identity/v3/role_assignments?user.id=59cd2e1fa2d34c63838a3a5df743541a&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:11.578077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 71/136] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:24:11 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:13.519379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfee83-c91e-4186-b092-7adb578e9b8f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:13.521477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfee83-c91e-4186-b092-7adb578e9b8f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:13.521477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfee83-c91e-4186-b092-7adb578e9b8f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:13.524010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 66/137] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:13.540163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:13.540688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:13.541159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:13.583496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:13.585690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:13.729504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 72/138] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:13.806052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfee83-c91e-4186-b092-7adb578e9b8f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:13.836353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfee83-c91e-4186-b092-7adb578e9b8f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:13.843289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:13.844158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:13.844445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:13.844859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:13.869052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:13.876471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:13.878125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 67/139] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:13.887693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:13.913090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2467e1f-0689-43d5-84ac-c89f7cba38ad None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:13.925394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:13.926547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:13.927073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:13.927559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:13.928985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:13.929550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:13.932742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:13.957196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 73/140] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:13.965392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:13.984923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbe37-080c-44cd-a045-6dd22e56f4fc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:13.999872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:14.001465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.002336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.002868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.005226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:14.009768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:14.016896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 68/141] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:13 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:14.018573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:14.036379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24090d-4306-4d93-9428-819fb2d74126 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:14.047402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:14.048114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.048405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.048685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.067266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:14.069029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:14.085294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 74/142] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:14.091679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:14.115838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b2a27-c56a-4a79-b648-8de13f9fecc5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:14.131773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:14.133314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.133792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.134253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.136418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:14.140429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826aabc-5e64-4f91-acbf-6fa6fcf744f5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:14.148113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 69/143] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:14 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:14.149451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:14.162444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00655-deec-404d-afa9-2382ac3af087 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:14.176536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:14.177232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.177518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.177798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.178698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:14.179019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:14.181001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2175de-12a7-4020-9f4d-8d1a21705a37 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:14.192202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 75/144] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:14 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=9af319ef09aa4cd69445115653b41037 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:14.753305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df157-fee4-439f-8e00-bbae04e89f8d None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.753822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df157-fee4-439f-8e00-bbae04e89f8d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.754208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df157-fee4-439f-8e00-bbae04e89f8d None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.757585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 70/145] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:14.764720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.765248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.765730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.802928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:14.804945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:14.825031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 76/146] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:14.858351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df157-fee4-439f-8e00-bbae04e89f8d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:14.888439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df157-fee4-439f-8e00-bbae04e89f8d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:14.899881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:14.901316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.901809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.902289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.928918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:14.943749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f51ba87a-2d9e-4ad7-a74c-368e7b02963d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:14.946028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 71/147] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:14.952504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:14.969537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5609e3-d173-486d-8a0e-d10e4f4fcf5d None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.970052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5609e3-d173-486d-8a0e-d10e4f4fcf5d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.970550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5609e3-d173-486d-8a0e-d10e4f4fcf5d None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:14.974029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 72/148] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:14.985061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514d0a5-bf79-401a-b0c6-fced7bd1733a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:14.991645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:14.992186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:14.992714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.000911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.002466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.002983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.003581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.005032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.005556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.009133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.026183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 77/149] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.033336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.046116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:15.048050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:15.050352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004284-11fb-4b43-93d1-1f2be34a0187 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.058760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.059120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 73/150] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:15.062794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.062794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.062794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.064190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.069272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.072691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 78/151] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.081476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.092317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae68b-bf7c-4315-8ad5-2f2b0a83067e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.097830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.098571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.098911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.099189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.108995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.110883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.121468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 74/152] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:15.127779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.139067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.140517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc551-3b4d-48bb-b904-85e404afd745 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.154187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.155121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.155555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.155833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.157278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.159858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09350-193d-47be-a4d7-2a5b3e839899 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.160927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.170272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 79/153] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.173101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.173868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.175871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.176177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.176429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.193777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:15.194286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd91e-61ae-4826-8f07-24e31fbf436a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.201507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:15.202907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 75/154] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:15.209037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.215437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.216131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.216421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.216703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.217590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.217987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.219879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8885-c869-4209-b48f-6b95c5bc32d5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.220124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.225671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.226377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.226685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.227027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.227825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.228136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.229962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.236964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 80/155] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=8eff1ce623524530832effb4e96fb820 => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.241039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 76/156] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:15.247600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.277029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266e5b-2e68-40d1-9188-4d2667f7392a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.293511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.295067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.295560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.296104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] PATH_INFO: `/v3/users/203b86d4b17b44b7b8c725bbce8d9578` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.302301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] RBAC: Authorizing `identity:get_user(user_id=203b86d4b17b44b7b8c725bbce8d9578)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.305855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032d26f-f746-4fdd-afc5-aca256fbb7fc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.308970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 81/157] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/users/203b86d4b17b44b7b8c725bbce8d9578 => generated 247 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.315374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.329929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14abb81-33c4-4d02-9e29-f53ebc60a0be admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.347243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.347939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.348227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.348556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.369671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.373255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.389449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6b37-2634-4a77-89ed-bb4cb03e4d87 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.389960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6b37-2634-4a77-89ed-bb4cb03e4d87 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.390471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6b37-2634-4a77-89ed-bb4cb03e4d87 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.390983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 77/158] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:15.393934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 82/159] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:15.396660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.403517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.403985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.404473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.412276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a06-44b5-41a3-bdf5-70c16c1cce08 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.423528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.424442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.424720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.424990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.426436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.428624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.430757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 78/160] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:15.439435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.441569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:15.444310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:15.454743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5b12-0888-4333-bed1-a49a88a229b0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.463448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.464614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.465960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.467194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.469455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=203b86d4b17b44b7b8c725bbce8d9578) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.469989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 83/161] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:15.470553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.472811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.480390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 79/162] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/role_assignments?user.id=203b86d4b17b44b7b8c725bbce8d9578&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:15.536613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.547258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6048d2-6f91-49aa-a086-798592d3fe0e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.557841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.559305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.559816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.560267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.586050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:15.593854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:15.595945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 84/163] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:15.605175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.616177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6cbf9-d5ec-49db-bda5-78b430309e37 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.621339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.622356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.622837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.623310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.624406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.624901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.627243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.637745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 80/164] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.646277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.657269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ecba-1b72-4124-926f-ef9f223f3620 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.664287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.665616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.666326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.667174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] PATH_INFO: `/v3/users/5707e260eb2943eebfe40a32c3e5b3da` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.668961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] RBAC: Authorizing `identity:get_user(user_id=5707e260eb2943eebfe40a32c3e5b3da)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.671774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.673910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 85/165] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/users/5707e260eb2943eebfe40a32c3e5b3da => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:15.686284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.699202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8a420-c1fe-4a48-be51-7e5024b7414b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.707039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.708116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.708574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.709011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.722038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.725330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.741797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 81/166] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:15.751594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.780184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031b0-71cd-4a78-9e41-56f425d44939 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.788200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.789746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.790223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.790748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] PATH_INFO: `/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.793281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=afb9c1f0e55f497b8133fbbbfb810f7c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.797791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced49895-9d93-4fb0-9db7-3fcf022d35b5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.801636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 86/167] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/projects/afb9c1f0e55f497b8133fbbbfb810f7c => generated 312 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:15.811462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.828079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521eefd-04a2-4fbb-ac49-a2f3372688d2 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.828361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a5ad-ebf1-4222-842c-2b0e354cb3cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.828673 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521eefd-04a2-4fbb-ac49-a2f3372688d2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.829159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521eefd-04a2-4fbb-ac49-a2f3372688d2 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.833014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 87/168] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:15.837430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.838116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.838445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.838642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.839568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=afb9c1f0e55f497b8133fbbbfb810f7c, user.id=5707e260eb2943eebfe40a32c3e5b3da) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.839876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.840411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.840699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.840976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.841800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.849380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 82/169] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/role_assignments?user.id=5707e260eb2943eebfe40a32c3e5b3da&scope.project.id=afb9c1f0e55f497b8133fbbbfb810f7c&role.id=9af319ef09aa4cd69445115653b41037 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.865690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:15.867110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:15.875646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 88/170] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:15.899206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.910453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a90203-0273-4814-95de-de54d0b7c0a5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.916184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.917353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.917816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.918259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.931520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:15.939356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:15.941294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 83/171] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:15.950445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:15.961797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b484ae-dfaf-476c-a5b2-ffbbb701d329 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:15.966984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:15.967696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:15.968116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:15.968600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:15.970114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:15.970694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:15.972533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:15.986320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 89/172] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:15.994355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:16.014174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76fe2-266a-4d72-81aa-e970bd3c5a09 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:16.021830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:16.023436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.023854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.024273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] PATH_INFO: `/v3/users/59cd2e1fa2d34c63838a3a5df743541a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.026526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] RBAC: Authorizing `identity:get_user(user_id=59cd2e1fa2d34c63838a3a5df743541a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:16.030793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:16.034015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 84/173] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:15 2022] GET /identity/v3/users/59cd2e1fa2d34c63838a3a5df743541a => generated 289 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:16.042312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:16.053032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b70e7-36c7-4be4-ab7b-c2a44fcb26eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:16.073784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:16.075208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.075708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.076291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.079194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:16.083333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835a58-dc9c-43de-bf17-ec4adbb532bd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:16.086725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 90/174] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:16 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:16.095847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:16.107548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64bbec-017e-4846-ac44-596243a8aec8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:16.113422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:16.114483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.114800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.115071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/59cd2e1fa2d34c63838a3a5df743541a/roles/f2c15baab3ff4e0b8f6d01db499e9f80` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.117211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, user_id=59cd2e1fa2d34c63838a3a5df743541a, role_id=f2c15baab3ff4e0b8f6d01db499e9f80)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:16.119959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ae74b-a636-4871-a9c8-a068b39df131 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:16.137443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 85/175] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:16 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/users/59cd2e1fa2d34c63838a3a5df743541a/roles/f2c15baab3ff4e0b8f6d01db499e9f80 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:16.149896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80b7e-2da5-49e2-b25f-f42ba8bd8a9c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.150273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80b7e-2da5-49e2-b25f-f42ba8bd8a9c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.150636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80b7e-2da5-49e2-b25f-f42ba8bd8a9c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.153545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 91/176] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:16.160874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.161158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.161432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.180628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:16.181888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:16.249512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 86/177] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:16.276124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f80b7e-2da5-49e2-b25f-f42ba8bd8a9c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:16.289715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f80b7e-2da5-49e2-b25f-f42ba8bd8a9c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:16.294884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:16.295848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.297314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.297680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.299415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:16.301314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d7ef2-5bbd-45f2-a0e5-d0584138ecb1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:16.303124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 92/178] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:16.310041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:16.321814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076322ea-886c-4258-98d8-53fa1c886bda None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:16.325105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:16.325935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:16.326282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:16.326605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:16.327667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:16.330431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23720c-603f-47f7-8727-4232fc2c3c61 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:16.359044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 87/179] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:16 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:24:19.293287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487af9-ea8c-41b5-a6f4-97abdd0db784 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.294281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487af9-ea8c-41b5-a6f4-97abdd0db784 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.294281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487af9-ea8c-41b5-a6f4-97abdd0db784 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.295650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 93/180] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:19.301688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.302374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.302374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.321559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:19.322825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:19.330822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 88/181] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:19.354997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487af9-ea8c-41b5-a6f4-97abdd0db784 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.368279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487af9-ea8c-41b5-a6f4-97abdd0db784 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.372940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.373755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.374091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.374322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.386417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:19.393717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:19.395022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 94/182] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:19.401267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.411318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9cad8-3f81-4221-9135-383f53e0b30a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.416312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.417042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.417306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.417563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.418378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:19.418713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.420383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.430029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 89/183] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:19.435908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.447180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee113fe6-e21e-4535-9a6c-ba4d8890a8bf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.452893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.453824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.454104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.454362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.481308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.485552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.489151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 95/184] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:19.496479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.507434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fd850-949e-4e6c-8fb3-63f6de4b4bfc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.512061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.512718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.512997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.513270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.522364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.524198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.538837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 90/185] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:19.540965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.552027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc55946-e678-41ad-b0cc-4c91db955250 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.557698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.558129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.558129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.558541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.559725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.561947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ee7ea-9ebb-4ffd-ae46-acd76a736b85 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.563823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 96/186] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:19.570348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.580023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cc396-d62c-4278-a827-4a02a7814a88 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.584898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.585590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.585869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.586143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.587095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=f3608e653eb7486eb12a51b5682f89d2) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:19.587401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.589294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31f1f9-c0ec-4c75-8790-dcb57bee363a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.595879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 91/187] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/role_assignments?user.id=f3608e653eb7486eb12a51b5682f89d2&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:19.633198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698d09-1bf9-4011-90a6-1258d3b7545f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.633617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698d09-1bf9-4011-90a6-1258d3b7545f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.634108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698d09-1bf9-4011-90a6-1258d3b7545f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.637596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 97/188] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:19.646318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.646644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.646891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.666142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:19.667405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:19.680493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 92/189] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:19.717521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698d09-1bf9-4011-90a6-1258d3b7545f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.739543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698d09-1bf9-4011-90a6-1258d3b7545f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.747328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.748761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.749334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.749819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.772661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:19.787077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:19.789747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 98/190] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:19.799116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.813428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dece67-9973-4a2e-af41-8654da22c923 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.818378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.819231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.819756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.820040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.820895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:19.821200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.823127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.834231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 93/191] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:19.844600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.863251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3055e-3197-4215-b519-6f547d318f8e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.870895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.872380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.872836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.873301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] PATH_INFO: `/v3/users/59cd2e1fa2d34c63838a3a5df743541a` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.875761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] RBAC: Authorizing `identity:get_user(user_id=59cd2e1fa2d34c63838a3a5df743541a)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.880377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.883894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 99/192] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/users/59cd2e1fa2d34c63838a3a5df743541a => generated 289 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:19.893086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.910072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d6f9-cb41-4059-8705-7829bf2af640 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.917330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.918489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.919003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.919469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.933200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.935033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.945240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 94/193] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:19.951364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.962011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337a590-e6f1-4a8a-946f-13176fa29227 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.966569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.967498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.967809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.968090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.969317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.971506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdcb6a-9861-4151-8a17-5c46dde30407 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:19.973292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 100/194] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:19.979698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:19.989227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ebe4-9d4a-4bb6-a320-78578dce0f1b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:19.994126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:19.994849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:19.995130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:19.995494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:19.996368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c, user.id=59cd2e1fa2d34c63838a3a5df743541a) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:19.996677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:19.998688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14935951-5321-4a98-a55c-0a7192070817 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.009363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 95/195] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:19 2022] GET /identity/v3/role_assignments?user.id=59cd2e1fa2d34c63838a3a5df743541a&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:20.046705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4a8-87f6-422a-a91d-d1c47551c8ea None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.046705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4a8-87f6-422a-a91d-d1c47551c8ea None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.046705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4a8-87f6-422a-a91d-d1c47551c8ea None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.047797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 101/196] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:20.056098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8a8-e5c9-4fc6-8084-dee90d163a38 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.056544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8a8-e5c9-4fc6-8084-dee90d163a38 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.056991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8a8-e5c9-4fc6-8084-dee90d163a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.085785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8f24e8a8-e5c9-4fc6-8084-dee90d163a38 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:20.087694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f24e8a8-e5c9-4fc6-8084-dee90d163a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:20.100311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 96/197] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:20.136548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4de4a8-87f6-422a-a91d-d1c47551c8ea None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.156213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4de4a8-87f6-422a-a91d-d1c47551c8ea None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.163872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.165773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.166585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.167342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.187137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:20.201379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:20.203930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 102/198] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:20.211345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286db1-4fc6-47ac-9953-bad66a79e21f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.211622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286db1-4fc6-47ac-9953-bad66a79e21f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.211898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286db1-4fc6-47ac-9953-bad66a79e21f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.213916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 97/199] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:20.214292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.220176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.220445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.220713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.232826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45f59f-f4a1-48d5-bf15-d904439a2be4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.240243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.241155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:20.242027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.242414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:20.243044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.243724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.245308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:20.246091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.249326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.251301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 98/200] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:20.267125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 103/201] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:20.277003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.278612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.293941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26929a44-f74e-40a9-bdd9-51df61d6b9aa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.297478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90171c3-938e-4611-a30f-2c66e4bbe51d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.298595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.299471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.299747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.300027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.301361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.304275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.304965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 104/202] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:20.307734 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.310080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.310836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.310976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.311734 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.314008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.318007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.321132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 99/203] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:20.325593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fcaa0-3105-4b63-a888-b1bc42ce90a6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.327162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.327869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.328155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.328495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.329433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.330903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.331477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.349718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514f0b-a279-4b15-8dbe-113e7fb7436e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.355934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.356555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.356829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.357186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.367505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.368773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 105/204] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:20 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:24:20.370404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.381584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 100/205] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:20.392175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.412401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36c9f7-212a-499c-bf5b-2411a52cc428 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.420115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.421801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.422314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.422864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.425402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.429841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512de6-92c5-48e5-bf7c-514ac195697f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.433460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 106/206] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:20.444090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:20.461336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22374936-ff95-4bbc-bc64-efc83b32b8ad admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:20.469629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:20.470815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:20.471309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:20.471789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:20.473481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=f3608e653eb7486eb12a51b5682f89d2) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:20.474032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:20.477799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20dba-c43c-4086-84a6-fd14d64351a1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:20.489905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 101/207] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:20 2022] GET /identity/v3/role_assignments?user.id=f3608e653eb7486eb12a51b5682f89d2&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=8eff1ce623524530832effb4e96fb820 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:22.822409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a912-7c0f-4a99-9582-7f9508b8fb3e None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.823465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a912-7c0f-4a99-9582-7f9508b8fb3e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.823979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a912-7c0f-4a99-9582-7f9508b8fb3e None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.826152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 107/208] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:22.832462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285e2c-c2ea-4e02-ae45-b28783644220 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.832962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285e2c-c2ea-4e02-ae45-b28783644220 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.832962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad285e2c-c2ea-4e02-ae45-b28783644220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.858760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ad285e2c-c2ea-4e02-ae45-b28783644220 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:22.860002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ad285e2c-c2ea-4e02-ae45-b28783644220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:22.869691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 102/209] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:22.880263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111c7f-d20f-4540-afc8-b6e78433d7fe None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.880577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111c7f-d20f-4540-afc8-b6e78433d7fe None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.880811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f111c7f-d20f-4540-afc8-b6e78433d7fe None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.882949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 108/210] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:22.889076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.889643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.890057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.904486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f111c7f-d20f-4540-afc8-b6e78433d7fe None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:22.909354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:22.910743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:22.917676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f111c7f-d20f-4540-afc8-b6e78433d7fe None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:22.920626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 103/211] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:22.927618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:22.928523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.928914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.929322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.941562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:22.947644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:22.949607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:22.951264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 109/212] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:22.960941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:22.962428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e026-3f59-4b83-9b1f-9d6bdd42cf31 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:22.967047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:22.968372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.969387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.969805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.973357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7374b-59f3-42e2-8843-6ddefb95478d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:22.978724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:22.979862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:22.980242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:22.980618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:22.981480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:22.981927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:22.983457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:22.984146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:22.992624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:22.999522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 110/214] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:22.999909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 104/214] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:23.001093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.001559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.012839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaccf16-a423-4bac-a9a0-e33274f2a9e1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.013308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09395-3f2a-461d-a0fd-a4ba8641302f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.018280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.018479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.019404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.019508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.019860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.020182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.020279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] PATH_INFO: `/v3/users/eeb92c043bf64b76a59014e10fb19df3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.020702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.021824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:23.022315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.025378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.041313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] RBAC: Authorizing `identity:get_user(user_id=eeb92c043bf64b76a59014e10fb19df3)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.041313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.041313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 111/216] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:22 2022] GET /identity/v3/users/eeb92c043bf64b76a59014e10fb19df3 => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.041785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 105/216] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:23.046583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.046793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.057852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bed3-3556-4df8-855a-cd3ed5561084 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.058356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a12b1-0f28-458c-aec0-9548c29f6ab8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.062694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.063686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.063938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.064049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.064207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.065159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.065441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.065848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.066314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.067728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.073951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 112/217] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.075677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.079581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.081631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.086933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5615d-6043-41b6-b9cb-754074e44142 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.091758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.092686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.092969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.093244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.094529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.095702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 106/218] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:23.096703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.103096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 113/219] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:23.104918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.108308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.116635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a097d4e-5f57-40bc-af2e-ffa70b5a5579 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.120277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746260-b800-443b-a414-47e999e1fbce admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.121800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.122955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.123244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.123518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.125200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.127246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.128011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.128686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.129184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.129647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/users/f3608e653eb7486eb12a51b5682f89d2/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.134821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 107/220] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.135010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, user_id=f3608e653eb7486eb12a51b5682f89d2, role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.136510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa452dab-4c79-4560-a7b5-aeedf8824b09 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.140182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.150968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98916fa-78a4-43a5-8b33-a49ab3ff4aca admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.162687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 114/221] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:23 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/users/f3608e653eb7486eb12a51b5682f89d2/roles/8eff1ce623524530832effb4e96fb820 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:23.222932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.223575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.223861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.224125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.225011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=eeb92c043bf64b76a59014e10fb19df3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:23.225322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.227469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807fb47-2b59-4967-ba0a-c87dfa2d99c8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.234328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 108/222] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/role_assignments?user.id=eeb92c043bf64b76a59014e10fb19df3&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=9af319ef09aa4cd69445115653b41037 => generated 259 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:23.342972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879320-c305-4a74-b972-356ea4a10b06 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.343295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879320-c305-4a74-b972-356ea4a10b06 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.343536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1879320-c305-4a74-b972-356ea4a10b06 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.345445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 115/223] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:23.355364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1565-9bc6-4985-8db5-a2f05ef1e96c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.355824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1565-9bc6-4985-8db5-a2f05ef1e96c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.356279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1565-9bc6-4985-8db5-a2f05ef1e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.387849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-404f1565-9bc6-4985-8db5-a2f05ef1e96c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:23.390148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-404f1565-9bc6-4985-8db5-a2f05ef1e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:23.403809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 109/224] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:23.412224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d7bd-74dd-4cab-b743-6edbfac25a2f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.412523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d7bd-74dd-4cab-b743-6edbfac25a2f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.412786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d7bd-74dd-4cab-b743-6edbfac25a2f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.414616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 116/225] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:23.420792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.421084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.421353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.435989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966d7bd-74dd-4cab-b743-6edbfac25a2f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.443398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:23.445505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:23.450468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966d7bd-74dd-4cab-b743-6edbfac25a2f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.458846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.459685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.459959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.460225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.460455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 110/226] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:23.482511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:23.490366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.496986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:23.499729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 117/227] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:23.500876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78142-b8ac-4d32-8faa-9ac55d08a782 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.505938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.507077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.507551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.508052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.509523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.509627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.511697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.513585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 111/228] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:23.519759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.528263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6e1f-dfc2-4992-b99e-bab387288765 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.533334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570829e0-abf3-46db-9bbc-581620bc1e4d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.536115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.537296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.537813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.538237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.539685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.539806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:23.540254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.540934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.541398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.541953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.542918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.543358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.545391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.562818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 118/229] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.567656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.578852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 112/230] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:23 2022] POST /identity/v3/users => generated 297 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:23.588904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58c821-3dd0-4aba-ae70-dcd216df3ed6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.597808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.599992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.600814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.601467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.604475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.609596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.613718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 119/231] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.620181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.631987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abffcd-dfea-4248-a7e3-f1f14e4452aa admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.636803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.637906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.638324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.638709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.640213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.642564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dc6ea-08f9-47ac-ab1d-843ef9ff9491 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.644572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 113/232] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:23 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:23.650792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:23.661475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b87b76-90e8-4613-846e-e3716209a902 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:23.666357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:23.667474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:23.667859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:23.668225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/users/f3608e653eb7486eb12a51b5682f89d2/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:23.670386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, user_id=f3608e653eb7486eb12a51b5682f89d2, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:23.673347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828a0fc-5835-472f-bd5e-e5d5f6ec2ce4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:23.689667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 120/233] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:23 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/users/f3608e653eb7486eb12a51b5682f89d2/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:25.844564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113e38-0f35-44c4-80a0-c08118e0108e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:25.846067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113e38-0f35-44c4-80a0-c08118e0108e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:25.846912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113e38-0f35-44c4-80a0-c08118e0108e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:25.850973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 114/234] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:25.860683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a2eb-db11-49f5-b223-733b515b413a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:25.862124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a2eb-db11-49f5-b223-733b515b413a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:25.862904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a2eb-db11-49f5-b223-733b515b413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:25.894524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2891a2eb-db11-49f5-b223-733b515b413a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:25.897072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2891a2eb-db11-49f5-b223-733b515b413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:25.976195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 121/235] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:25.977354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac6a0-1202-49bd-88ed-e4a76d39f73c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:25.978132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac6a0-1202-49bd-88ed-e4a76d39f73c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:25.978962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac6a0-1202-49bd-88ed-e4a76d39f73c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:25.982582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 115/236] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:25.999801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.000196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.000437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.022795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:26.024016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:26.027149 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac6a0-1202-49bd-88ed-e4a76d39f73c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.038684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 122/237] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:26.056695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.063791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac6a0-1202-49bd-88ed-e4a76d39f73c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.075364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021325f-0d34-436e-bb7d-b68b35322b84 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.079227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.080968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.083112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.084570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.095902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.102015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.102936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.103707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.125654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:26.135029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:26.150847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:26.151289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:26.153368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 116/238] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:26.154187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 123/239] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:26.164896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.165298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.176597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52895fd-2f83-46fb-be4e-bb33fa9c564b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.191045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8576f-a87f-4259-90bf-54bbecfec87a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.194122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.195173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.195654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.196121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.197120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:26.198098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.200381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.206214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.207223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.207717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.208197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.212227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:26.212795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.214634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.227652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 117/240] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.235230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 124/241] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.240261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.247698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.254618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafc0cb-6e8f-4f2b-bfc0-696308478c95 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.260146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91f8b-3ff6-46b9-98c7-282f9e183710 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.265904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.267642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.268002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.269119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.269619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.270085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.270546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.271024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] PATH_INFO: `/v3/users/eeb92c043bf64b76a59014e10fb19df3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.273167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.274067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=eeb92c043bf64b76a59014e10fb19df3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.276851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.278973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.281018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 118/242] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/users/eeb92c043bf64b76a59014e10fb19df3 => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:26.287614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 125/243] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.289131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.297159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.308460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ce8e8-65c5-4bef-9cb8-31aefa316e42 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.312497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ccedf-8aac-49b2-b2c2-35de177c50c2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.317029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.317929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.318214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.318489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.320120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.322950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.329931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 126/244] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.331712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.333627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.334805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.335306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.335800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.345977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73663ea7-a856-4d33-a5e3-819da0b04d9b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.355454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.356039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.357432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.357710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.357975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/users/eeb92c043bf64b76a59014e10fb19df3/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.359445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.364121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, user_id=eeb92c043bf64b76a59014e10fb19df3, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.368914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.379171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 119/245] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:26.388015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.399860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8fd43-9daf-4159-818f-ddc77560f777 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.403306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 127/246] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:26 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/users/eeb92c043bf64b76a59014e10fb19df3/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:26.517677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.519317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.519841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.521248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.522702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.526720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb821e-32af-479b-a31f-d62ef3a8b8ea admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.531993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 120/247] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.538748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.558688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91793-84b6-4392-971b-6a718b71a2f7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.572302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.573373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.573860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.574317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.575538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=f3608e653eb7486eb12a51b5682f89d2) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:26.576041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:26.578230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95f91-c3ae-4369-923a-1905674f4a56 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:26.592074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 128/248] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/role_assignments?user.id=f3608e653eb7486eb12a51b5682f89d2&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=8eff1ce623524530832effb4e96fb820 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:26.855500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431c7d-e724-4682-9cd8-66a10519c722 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.856027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431c7d-e724-4682-9cd8-66a10519c722 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.856406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431c7d-e724-4682-9cd8-66a10519c722 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.860162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 121/249] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:26.866778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.867815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.868286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.889012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1690a8-bce4-45ee-8c71-4585e5700804 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.889556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1690a8-bce4-45ee-8c71-4585e5700804 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.890016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1690a8-bce4-45ee-8c71-4585e5700804 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.893515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 122/250] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:26.894281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:26.895892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:26.906689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.906689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.906689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.911535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 129/251] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:26.935487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.936386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:26.938421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:26.948737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4757ea-de7a-4e3d-95c3-bec4e3387332 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:26.951691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 123/252] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:26.961821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:26.963054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:26.963577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:26.964060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:26.985847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:26.991085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:26.994191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:26.995773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 130/253] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:27.002379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.009560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8cc5-5812-421f-af96-96cc6df9471b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.014539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009073d-6b1a-4551-ae6c-1d108533f9e3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.017700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.019044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.019499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.019953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.026745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.027771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.028303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.028776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.029756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:27.030399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.032426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.039488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:27.049415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 131/254] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:27.054913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:27.055500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.057651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 124/255] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:27.066789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.071442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e678-7149-4de3-9f83-cb1f2c2c43fe admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.081192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf198-277d-460a-b716-94843d45604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.082458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf198-277d-460a-b716-94843d45604b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.082973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf198-277d-460a-b716-94843d45604b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.083455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adf198-277d-460a-b716-94843d45604b admin admin] PATH_INFO: `/v3/users/915ba27b86984926a636d6fc0c486c92` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.083554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eba26-b854-4939-b9f7-857d5c93d878 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.100717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.101863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.102340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.102847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.104263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:27.104825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.107981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.110442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adf198-277d-460a-b716-94843d45604b admin admin] RBAC: Authorizing `identity:get_user(user_id=915ba27b86984926a636d6fc0c486c92)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.112906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adf198-277d-460a-b716-94843d45604b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.119956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 132/256] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/users/915ba27b86984926a636d6fc0c486c92 => generated 297 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:27.121216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf198-277d-460a-b716-94843d45604b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.124496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 125/257] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:27.132770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adf198-277d-460a-b716-94843d45604b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.133307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.137945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.138902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.139454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.139925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.148830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.150416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554b737-3339-4bcc-a712-de16d323f13f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.151278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.158037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.159590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.160086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.160594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] PATH_INFO: `/v3/users/f3608e653eb7486eb12a51b5682f89d2` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.162791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3608e653eb7486eb12a51b5682f89d2)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.168268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 133/258] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:27.168430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.169836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.170462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 126/259] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/users/f3608e653eb7486eb12a51b5682f89d2 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:27.178839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.179491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a594fd-4022-4fd8-b30d-99b3e0c3cc8f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.183891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.184766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.185046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.185318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.186641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.188744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.190644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 134/260] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:27.196359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fe249-d60f-454b-a596-c3ae6791b7c1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.197169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.203791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.204798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.205266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.205749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.209217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57a46-b77a-4a1a-b012-2e67449e3cc5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.213954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.215139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.215739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.216214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.218012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=915ba27b86984926a636d6fc0c486c92) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:27.218506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.220957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.221230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.224919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74748fcd-498a-4102-837c-81edcca394fa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.233012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 135/261] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/role_assignments?user.id=915ba27b86984926a636d6fc0c486c92&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:27.243590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 127/262] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:27.253790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.272210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e2ea5-0dc9-4840-8b28-ae9b2f091d26 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.280290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.281963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.282492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.283012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.285319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.289604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.293618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 136/263] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:27.303783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da4dd-b907-4638-bf51-0d630991b2bf None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.304233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da4dd-b907-4638-bf51-0d630991b2bf None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.304527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.304649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da4dd-b907-4638-bf51-0d630991b2bf None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.307887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 128/264] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:27.316880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.317328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.317762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.322678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762443c-c6ce-453c-b732-459577d37cd6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.329843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.330988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.331461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.331929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.333601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=f3608e653eb7486eb12a51b5682f89d2) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:27.334170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.337938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.348799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:27.349518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 137/265] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/role_assignments?user.id=f3608e653eb7486eb12a51b5682f89d2&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:27.351733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:27.365180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 129/266] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:27.404992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.421557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489620-11d9-4133-a85f-d75f4ef8f5bc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.428418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.429977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.430637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.431303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.433718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.437122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736dabe-44c6-4659-8175-26eb8a0e6f43 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.447223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 138/267] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:27.451196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:27.466466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbdaf4-fc7f-473e-b14f-8cb7a9009683 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:27.469513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:27.470255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:27.470534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:27.470830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:27.471583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:27.473616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dea35f-da48-4a9d-bd4f-1212daf44d53 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:27.506348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 130/268] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:27 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:29.603957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e06c2-5712-4dd4-b0e0-af328e3c0340 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.604543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e06c2-5712-4dd4-b0e0-af328e3c0340 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.604543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e06c2-5712-4dd4-b0e0-af328e3c0340 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.606805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 139/269] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:29.614511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.615115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.615548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.648381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:29.650474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:29.664406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 131/270] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:29.698407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e06c2-5712-4dd4-b0e0-af328e3c0340 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.720610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e06c2-5712-4dd4-b0e0-af328e3c0340 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:29.728724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:29.730126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.730619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.731508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.750441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:29.765025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:29.767745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 140/271] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:29.773424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.783398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877a23-9008-4e89-9453-8a9f87a16d55 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:29.788632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:29.789590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.790095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.790564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.791586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:29.792083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:29.793886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:29.809919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 132/272] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:29.811817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.822735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd05d-288b-4f2f-983b-05e1eb940f4f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:29.827833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:29.829013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.829511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.829978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] PATH_INFO: `/v3/users/915ba27b86984926a636d6fc0c486c92` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.831508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] RBAC: Authorizing `identity:get_user(user_id=915ba27b86984926a636d6fc0c486c92)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:29.833861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794548de-7139-4e98-93bd-bd509445e1fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:29.836286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 141/273] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:29 2022] GET /identity/v3/users/915ba27b86984926a636d6fc0c486c92 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:29.843111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.851639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796870cc-989f-4327-9717-05be3224654c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.851926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796870cc-989f-4327-9717-05be3224654c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.852238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796870cc-989f-4327-9717-05be3224654c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.854070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 142/274] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:29.857882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4629a0-30f9-47e4-8a3d-337da6c83607 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:29.862924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:29.864655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.864942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.865214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.866006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.867158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.868098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.870929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:29.875412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:29.879478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 133/275] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:29 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:29.887452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.890947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:29.892151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:29.906689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 143/276] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:29.911164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321468ae-95a6-4c56-a902-4062f549bf86 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:29.916055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:29.917314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:29.917738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:29.918158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/users/915ba27b86984926a636d6fc0c486c92/roles/f2c15baab3ff4e0b8f6d01db499e9f80` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:29.920520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, user_id=915ba27b86984926a636d6fc0c486c92, role_id=f2c15baab3ff4e0b8f6d01db499e9f80)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:29.923602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:29.946680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 134/277] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:24:29 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/users/915ba27b86984926a636d6fc0c486c92/roles/f2c15baab3ff4e0b8f6d01db499e9f80 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:29.948691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:29.966930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff40ccf-2f3f-4dc7-aee7-609ae1994c19 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.074296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.075800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.076289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.076785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.097216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:30.111508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:30.114151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 144/278] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:30.123963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.144684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb59599-2034-4e50-80eb-134b51b3810a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.152995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.153992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.154412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.154952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.156312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:30.156810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.159665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.180322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 135/279] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:30.188692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.209122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e51c0-eabf-426e-81fb-add1bf2825a1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.217165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.218985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.219661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.220226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] PATH_INFO: `/v3/users/eeb92c043bf64b76a59014e10fb19df3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.222811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] RBAC: Authorizing `identity:get_user(user_id=eeb92c043bf64b76a59014e10fb19df3)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.227279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.234880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 145/280] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/users/eeb92c043bf64b76a59014e10fb19df3 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:30.240023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.258181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ba2-e7d7-403a-a970-f9f91c4ec405 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.265721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.266985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.267476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.268007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.283444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.286958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.304953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 136/281] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:30.314265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.332510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d16c2b-a4ad-4dd0-9b04-0a431e4dc059 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.340251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.341836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.342334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.342932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.345325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.349955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37155246-1e0f-4347-88f4-350f74be217d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.354096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 146/282] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:30.365157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.382051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938975b1-e420-42c8-95b8-fda3bb819657 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.389656 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.390800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.391287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.391880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.393440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=eeb92c043bf64b76a59014e10fb19df3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:30.393977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.397708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457c665-abbf-49ef-9d3d-1b797952ef9c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.409624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 137/283] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/role_assignments?user.id=eeb92c043bf64b76a59014e10fb19df3&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=9af319ef09aa4cd69445115653b41037 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:30.524303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23aa42-93f4-40b2-891e-8862dc0a9e31 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.524725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23aa42-93f4-40b2-891e-8862dc0a9e31 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.524992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23aa42-93f4-40b2-891e-8862dc0a9e31 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.526896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 147/284] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:30.534672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.535185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.535667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.558154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:30.559464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:30.568183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 138/285] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:30.593812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23aa42-93f4-40b2-891e-8862dc0a9e31 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.607006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23aa42-93f4-40b2-891e-8862dc0a9e31 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.611787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.612796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.613103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.613339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.627386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:30.634932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:30.641408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 148/286] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:30.650938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.661248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e69894-e6bb-43e4-8906-97f41b6d610f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.669667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.671469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.672257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.673994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.675782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:30.676621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.679937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.698224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 139/287] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:30.703797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.720686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1095f56-277d-4014-828c-a2b6a0effcb3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.724686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.725598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.725887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.726158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] PATH_INFO: `/v3/users/43fa79568680442a98e0e8bc9698ea39` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.742788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=43fa79568680442a98e0e8bc9698ea39)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.745037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8ecee-16d2-4840-a2d7-cea7432e47d6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.747253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 149/288] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/users/43fa79568680442a98e0e8bc9698ea39 => generated 293 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:30.754035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:30.775479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7130bd-ae91-4447-8c75-fb747576757a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:30.784923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:30.785777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:30.786181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:30.786577 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:30.787623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, user.id=43fa79568680442a98e0e8bc9698ea39, scope.system=all) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:30.788052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:30.790150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1ab1-f724-45d2-91d9-0bebd5ed046d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:30.804792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 140/289] 10.222.0.32 () {56 vars in 1329 bytes} [Thu Feb 10 03:24:30 2022] GET /identity/v3/role_assignments?user.id=43fa79568680442a98e0e8bc9698ea39&scope.system=all&role.id=9af319ef09aa4cd69445115653b41037 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:31.429417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772e8-aa63-455f-bdb7-bb22edda778c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:31.429921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772e8-aa63-455f-bdb7-bb22edda778c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:31.430420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788772e8-aa63-455f-bdb7-bb22edda778c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:31.434089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 150/290] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:31.443041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:31.443545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:31.444031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:31.474526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:31.476528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:31.490415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 141/291] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:31.532864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788772e8-aa63-455f-bdb7-bb22edda778c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:31.554482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788772e8-aa63-455f-bdb7-bb22edda778c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:31.562185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:31.563599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:31.564095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:31.564588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:31.566750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:31.570018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05198a-dc44-445b-ab6d-dd73c13d1db2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:31.573358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 151/292] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:31.581329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:31.591188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc2c9f-e9fb-4980-83a6-65fefbb47427 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:31.596821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:31.597602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:31.597945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:31.598278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:31.599125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:31.601163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8e02c-bbcd-4aaa-8236-df5648689541 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:31.625130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 142/293] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:31 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:33.328713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8a97-bfe9-42fb-a3bb-93200b1acc18 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.329248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8a97-bfe9-42fb-a3bb-93200b1acc18 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.329652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8a97-bfe9-42fb-a3bb-93200b1acc18 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.332970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 152/294] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:33.341815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.343321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.344057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.375702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:33.378087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:33.390790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 143/295] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:33.429357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8a97-bfe9-42fb-a3bb-93200b1acc18 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.451491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8a97-bfe9-42fb-a3bb-93200b1acc18 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.459884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.461809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.462609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.463429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.484681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:33.498250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:33.501062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 153/296] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:33.510550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.527358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe7bb-e8ff-4bd8-a982-216c323a6345 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.535997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.537575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.538386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.539122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.540692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:33.541521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:33.544970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:33.562216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 144/297] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:33.572112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.597998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b4c2-c97d-4357-9239-7306eadd24e9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.605022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.606493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.607027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.607515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] PATH_INFO: `/v3/users/43fa79568680442a98e0e8bc9698ea39` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.609696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] RBAC: Authorizing `identity:get_user(user_id=43fa79568680442a98e0e8bc9698ea39)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:33.613650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705646d0-b51b-42d8-805c-d08f5921adda admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:33.616974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 154/298] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/users/43fa79568680442a98e0e8bc9698ea39 => generated 293 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:33.625361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.642872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b96f4-0126-4479-9c1b-bf112d6ca928 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.650788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.652635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.653365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.654121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] PATH_INFO: `/v3/system/users/43fa79568680442a98e0e8bc9698ea39/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.657180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=43fa79568680442a98e0e8bc9698ea39, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:33.659385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:33.659385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:33.659385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:33.661590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25215c17-ff65-4f54-a83d-ba6271ce0ebc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:33.698866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 145/299] 10.222.0.32 () {58 vars in 1355 bytes} [Thu Feb 10 03:24:33 2022] PUT /identity/v3/system/users/43fa79568680442a98e0e8bc9698ea39/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:33.744676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555924-9dc3-4b83-bb4c-d3dc7065dc6c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.745612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555924-9dc3-4b83-bb4c-d3dc7065dc6c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.746346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555924-9dc3-4b83-bb4c-d3dc7065dc6c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.750289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 155/300] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:33.760517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.761020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.761515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.789462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:33.791190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:33.802589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 146/301] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:33.845032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555924-9dc3-4b83-bb4c-d3dc7065dc6c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.868646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555924-9dc3-4b83-bb4c-d3dc7065dc6c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.877702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.879663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.880472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.881215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.902076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:33.914263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:33.916513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 156/302] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:33.926694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.943578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b87fa-6522-4473-9a99-ae5378d9d168 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:33.951268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:33.952466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:33.952943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:33.953415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:33.954849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:33.955461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:33.958576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:33.970441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 147/303] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:33.979367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:33.993408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db904f-08e5-440a-83e3-b93402eb329f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:34.000335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:34.001263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:34.001544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:34.002197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] PATH_INFO: `/v3/users/915ba27b86984926a636d6fc0c486c92` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:34.003574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] RBAC: Authorizing `identity:get_user(user_id=915ba27b86984926a636d6fc0c486c92)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:34.005933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:34.008013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 157/304] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:33 2022] GET /identity/v3/users/915ba27b86984926a636d6fc0c486c92 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:34.016967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:34.034472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc771024-a30a-4bac-8def-5d062ed61ae0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:34.042534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:34.044172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:34.044969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:34.045811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:34.062171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:34.066083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:34.084073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 148/305] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:34.093096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:34.109392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8a63e-c3b1-4f64-afa1-8063abc8e494 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:34.115975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:34.117792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:34.118552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:34.119410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:34.121787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:34.126047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d262f6-8ad1-486c-84ba-64e1972aa79b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:34.130327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 158/306] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:34 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:34.140496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:34.156986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8504-9d46-4fd3-b4d4-11cf722e24b3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:34.164763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:34.166326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:34.167097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:34.167871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:34.169744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, scope.project.id=81db714a86174045bcef3424fe37b717, user.id=915ba27b86984926a636d6fc0c486c92) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:34.170641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:34.174580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c611e7-a648-43bd-9724-02842b2eafe5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:34.186708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 149/307] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:24:34 2022] GET /identity/v3/role_assignments?user.id=915ba27b86984926a636d6fc0c486c92&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:35.110966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4599-3658-433c-86fc-d966d34c1d14 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.111555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4599-3658-433c-86fc-d966d34c1d14 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.111933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4599-3658-433c-86fc-d966d34c1d14 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.115398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 159/308] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:35.123949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.124528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.124762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.151903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:35.153654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:35.164995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 150/309] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:35.205017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f4599-3658-433c-86fc-d966d34c1d14 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.225533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f4599-3658-433c-86fc-d966d34c1d14 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.232909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.234354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.234841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.235332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.255140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:35.269394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:35.271809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 160/310] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:35.280410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.292033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90cbec-38bf-470d-b180-d169438fdc33 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.297712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.298798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.299372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.299914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.301575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:35.302213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:35.305445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:35.322997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 151/311] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:35.329363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.346425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c16f86-4dd9-4490-964a-8bd43f7fc588 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.351709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.352633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.352905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.353222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] PATH_INFO: `/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.371344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d0e84a6d599e4af2b8df3d9ac4d2115e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:35.373672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51a5b-fead-489b-a50f-7f93f27163a9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:35.375795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 161/312] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:35 2022] GET /identity/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:35.382965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.400078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa60ac-8be2-4be8-a034-e3cf16a5112c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.407755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.408932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.409423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.409901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.411609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, user.id=d0e84a6d599e4af2b8df3d9ac4d2115e, scope.system=all) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:35.412154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:35.415355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06dbd5-b33e-4688-a897-7f6bbad762a3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:35.430776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 152/313] 10.222.0.32 () {56 vars in 1329 bytes} [Thu Feb 10 03:24:35 2022] GET /identity/v3/role_assignments?user.id=d0e84a6d599e4af2b8df3d9ac4d2115e&scope.system=all&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:35.473530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84029df-eb1e-4f1b-8877-757337c45c36 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.473989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84029df-eb1e-4f1b-8877-757337c45c36 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.474279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84029df-eb1e-4f1b-8877-757337c45c36 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.476262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 162/314] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:35.482567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.482932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.483220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.503853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:35.505145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:35.513530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 153/315] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:35.537193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84029df-eb1e-4f1b-8877-757337c45c36 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.551783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84029df-eb1e-4f1b-8877-757337c45c36 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.557168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.558018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.558296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.558586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.560106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:35.562049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979fece-8d2c-4523-9981-11c67b97e83d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:35.564283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 163/316] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:35.570056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:35.580360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43500fa3-6604-46e6-a7f2-c921aa66232b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:35.584945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:35.585650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:35.586035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:35.586327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] PATH_INFO: `/v3/groups` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:35.587019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:35.588088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:35.588088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:35.588088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:35.589391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463522e2-6712-4dcc-b594-37f6db13d58f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:35.607180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 154/317] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:24:35 2022] POST /identity/v3/groups => generated 229 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:36.083954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58562-dcac-47a1-a03e-c60e0a372aad None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.084357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58562-dcac-47a1-a03e-c60e0a372aad None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.084544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58562-dcac-47a1-a03e-c60e0a372aad None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.086296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 164/318] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:36.091852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.092133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.092451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.110989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:36.112169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:36.120271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 155/319] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:36.143969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee58562-dcac-47a1-a03e-c60e0a372aad None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:36.156959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee58562-dcac-47a1-a03e-c60e0a372aad None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:36.161331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:36.162207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.162547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.162905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.173931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:36.180993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:36.182411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 165/320] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:36.188330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:36.197347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0ac1-4336-4624-87fc-a4b8b52497e1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:36.201772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:36.202431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.202725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.202996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.203758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:36.204068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:36.205670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:36.214369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 156/321] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:36.220027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:36.230801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0cdb-c753-4904-80e7-737194e0e719 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:36.235244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:36.236105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.236385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.236651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] PATH_INFO: `/v3/users/43fa79568680442a98e0e8bc9698ea39` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.237853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] RBAC: Authorizing `identity:get_user(user_id=43fa79568680442a98e0e8bc9698ea39)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:36.239992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3161a8-5f95-4787-bc72-5fdbdf57af27 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:36.241735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 166/322] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:36 2022] GET /identity/v3/users/43fa79568680442a98e0e8bc9698ea39 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:36.247511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:36.257802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83da9-baa1-4834-aacf-ed2c845d14b2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:36.262105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:36.262774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:36.263063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:36.263312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:36.264128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] RBAC: Adding query filter params (role.id=9af319ef09aa4cd69445115653b41037, user.id=43fa79568680442a98e0e8bc9698ea39, scope.system=all) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:36.264482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:36.266325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ba76-5c5f-4eb0-b973-683d3405ef1b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:36.282181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 157/323] 10.222.0.32 () {56 vars in 1329 bytes} [Thu Feb 10 03:24:36 2022] GET /identity/v3/role_assignments?user.id=43fa79568680442a98e0e8bc9698ea39&scope.system=all&role.id=9af319ef09aa4cd69445115653b41037 => generated 510 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:37.763354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae61c-f490-4fe8-8015-22207dfbc18b None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.764189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae61c-f490-4fe8-8015-22207dfbc18b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.764189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae61c-f490-4fe8-8015-22207dfbc18b None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.766133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 167/324] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:37.772240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.772779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.772779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.792620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:37.793832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:37.802046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 158/325] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:37.825039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae61c-f490-4fe8-8015-22207dfbc18b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:37.838800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae61c-f490-4fe8-8015-22207dfbc18b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:37.844096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:37.844917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.845195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.845463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.858928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:37.866337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:37.868200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 168/326] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:37.874413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:37.884989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccb54-8d77-42d1-ad76-a2c84536bf74 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:37.890037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:37.890755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.891029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.891290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.892069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:37.892364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:37.894007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:37.904102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 159/327] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:37.910162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:37.920948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008169e-a755-4760-9b68-235b04454cf1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:37.925947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:37.926788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.927069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.927340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] PATH_INFO: `/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.928667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] RBAC: Authorizing `identity:get_user(user_id=d0e84a6d599e4af2b8df3d9ac4d2115e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:37.930892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b269d5-0590-4257-8ff6-55fa48146085 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:37.932968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 169/328] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:37 2022] GET /identity/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:37.939534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:37.957060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2f9e-e121-4138-b2a8-328795d420a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:37.964220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:37.965790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:37.966194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:37.966683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] PATH_INFO: `/v3/system/users/d0e84a6d599e4af2b8df3d9ac4d2115e/roles/f2c15baab3ff4e0b8f6d01db499e9f80` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:37.969442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d0e84a6d599e4af2b8df3d9ac4d2115e, role_id=f2c15baab3ff4e0b8f6d01db499e9f80)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:37.972553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2164d-ecd2-41ab-8c6c-2913ca4beb2a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:37.983593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 160/329] 10.222.0.32 () {58 vars in 1355 bytes} [Thu Feb 10 03:24:37 2022] PUT /identity/v3/system/users/d0e84a6d599e4af2b8df3d9ac4d2115e/roles/f2c15baab3ff4e0b8f6d01db499e9f80 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:38.857090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6bc0-72da-4e16-8a04-c67fbd31e699 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:38.857719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6bc0-72da-4e16-8a04-c67fbd31e699 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:38.858143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d6bc0-72da-4e16-8a04-c67fbd31e699 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:38.861464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 170/330] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:38.868306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:38.868842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:38.869212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:38.898251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:38.900341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:38.913394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 161/331] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:38.954334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6bc0-72da-4e16-8a04-c67fbd31e699 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:38.972014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d6bc0-72da-4e16-8a04-c67fbd31e699 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:38.977519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:38.978451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:38.978860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:38.979233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:38.980755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:38.982604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f697-b051-4928-9828-2becdf0c2082 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:38.984715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 171/332] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:38.993179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:39.003224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0209ac-9fda-42ce-a3b8-811ef5a994b8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:39.007989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:39.008780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:39.009145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:39.009497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] PATH_INFO: `/v3/groups` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:39.010346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:39.012469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffca2-40b6-4b03-b589-d92b095b860b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:39.028968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 162/333] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:24:38 2022] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:40.257990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ee06-04e0-4c00-97c5-d10990792247 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.258907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ee06-04e0-4c00-97c5-d10990792247 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.259051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ee06-04e0-4c00-97c5-d10990792247 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.262400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 172/334] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:40.268639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.269359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.269359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.296074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:40.297264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:40.309097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 163/335] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:40.334292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ee06-04e0-4c00-97c5-d10990792247 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:40.362836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ee06-04e0-4c00-97c5-d10990792247 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:40.375202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:40.376559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.377416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.377901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.404988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:40.427575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 10 03:24:40.430223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 173/336] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:40.435705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:40.449511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd08d-7d51-4c92-ab18-5c1a09f943a1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:40.462234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:40.462957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.463267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.463545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.464315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:40.464610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:40.466413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:40.485334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 164/337] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:40.491626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:40.521142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d183-5187-4bbe-bee8-3715a33dc1c0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:40.529331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:40.536084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.536704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.537298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] PATH_INFO: `/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.539876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] RBAC: Authorizing `identity:get_user(user_id=d0e84a6d599e4af2b8df3d9ac4d2115e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:40.546965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd882d-63a2-4d00-8c9f-985b6e080b0b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:40.550141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 174/338] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:24:40 2022] GET /identity/v3/users/d0e84a6d599e4af2b8df3d9ac4d2115e => generated 293 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:40.556270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:40.576645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bacf-ca03-4b62-a557-1771eb6ec86a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:40.587376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:40.588050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:40.588329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:40.588581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:40.589431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] RBAC: Adding query filter params (role.id=f2c15baab3ff4e0b8f6d01db499e9f80, user.id=d0e84a6d599e4af2b8df3d9ac4d2115e, scope.system=all) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:40.589720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:40.591662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6006c-c59a-4c8d-97e4-89772c35a85e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:40.604930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 165/339] 10.222.0.32 () {56 vars in 1329 bytes} [Thu Feb 10 03:24:40 2022] GET /identity/v3/role_assignments?user.id=d0e84a6d599e4af2b8df3d9ac4d2115e&scope.system=all&role.id=f2c15baab3ff4e0b8f6d01db499e9f80 => generated 510 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:41.757306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4a83-142f-4fb3-be9b-2b77b17ad1c4 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:41.758982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4a83-142f-4fb3-be9b-2b77b17ad1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:41.759795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c4a83-142f-4fb3-be9b-2b77b17ad1c4 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:41.764216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 175/340] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:41.770909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:41.772476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:41.773261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:41.820581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:41.823235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:41.843434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 166/341] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:41.883853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c4a83-142f-4fb3-be9b-2b77b17ad1c4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:41.914253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c4a83-142f-4fb3-be9b-2b77b17ad1c4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:41.925410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:41.927424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:41.928185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:41.928919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:41.960389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:41.975518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:41.978498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 176/342] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:41.985209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:42.003008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf4fa8-9fdf-4f4f-a18f-49ba54e1713b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:42.017501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:42.019175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:42.019925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:42.020702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:42.022415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:42.023285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:42.026687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:42.048235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 167/343] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:42.054058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:42.075866 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd03c-7c35-49ac-85f1-42e0e3808d40 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:42.089534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:42.091290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:42.092061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:42.092957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:42.113871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:42.117899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:42.141581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 177/344] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:42.147563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:42.165605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f2942-b81d-4fbf-ad57-86566e2dfb41 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:42.177855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:42.179793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:42.180545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:42.181285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:42.185241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:42.189568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:42.192970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 168/345] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:42 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:42.199614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:42.219812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62172a3-c9e3-469d-bf93-93c8bcec8fd5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:42.233060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:42.234993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:42.235725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:42.236387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:42.253349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:42.255639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:42.255639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:24:42.255639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:24:42.258346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197f5a9-13bd-4f2c-ba0b-cb6275197901 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:42.261608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 178/346] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:42 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:42.268500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:42.285554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dabc-de20-4347-9ff8-b0f35ca526a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:42.298005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:42.299605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:42.300348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:42.301106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:42.303007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:42.303957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:42.308122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10980b1f-c857-45fa-b633-115c18152bad admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:42.324047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 169/347] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:42 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=8eff1ce623524530832effb4e96fb820 => generated 260 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:43.252867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a053-8b05-449f-b401-65786976f0b6 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.254455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a053-8b05-449f-b401-65786976f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.255241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a053-8b05-449f-b401-65786976f0b6 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.259351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 179/348] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:43.269228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.270709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.271438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.310897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:43.313379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:43.330880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 170/349] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:43.406842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413a053-8b05-449f-b401-65786976f0b6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.437565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413a053-8b05-449f-b401-65786976f0b6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.449204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.451003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.451906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.452615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.484950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:43.509682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:43.512568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 180/350] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:43.521928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.549875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c4e4-96f1-4f4a-b80b-2b41fa219430 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.564975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.566222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.566731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.567205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.568569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:43.569079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:43.572389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:43.600682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 171/351] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:43.609706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.636671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ffbfe-28cb-418c-bc31-23047b968c6c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.645398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.646450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.646978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.647458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.677654 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:43.693536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:43.713555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 181/352] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:43.721296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.741194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9667ce-97e1-4b16-a2eb-6e9375286b3e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.753022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.754560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.755079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.755567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.764554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:43.768735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8c01-c40f-477d-b9b8-263ee26a01a5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:43.772076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 172/353] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:43.781388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.798706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a53c-8be9-4f6c-8b6f-7262a177edf0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.812459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.814002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.814478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.815013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.820132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:43.824110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c32d3-23fa-4892-a53a-c729f2aad654 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:43.827710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 182/354] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:43.831698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd22a4-6694-4e76-a102-a730913a0b5f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.832201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd22a4-6694-4e76-a102-a730913a0b5f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.832687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd22a4-6694-4e76-a102-a730913a0b5f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.837190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 173/355] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:43.843095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.843597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.844090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.852444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd22a4-6694-4e76-a102-a730913a0b5f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:43.901251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd22a4-6694-4e76-a102-a730913a0b5f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:43.913713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:43.914453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.914746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.915006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.915995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:43.916302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:43.918277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f46c-f034-4d66-9557-75a0da460d39 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:43.923554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:43.925603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:43.927458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 174/356] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:43 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=9af319ef09aa4cd69445115653b41037 => generated 260 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:43.928933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50bf3-1dcf-4bd0-b2e8-2299fbbf623f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.929204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50bf3-1dcf-4bd0-b2e8-2299fbbf623f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.929471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50bf3-1dcf-4bd0-b2e8-2299fbbf623f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.931771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 175/357] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:43.938236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:43.938815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:43.939284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:43.954723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 183/358] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:43.971786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:43.973071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:43.992031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 176/359] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:44.017245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.021242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.032248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5390-e5e7-4272-8883-63168702ed42 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.038231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.039418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.039843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.040246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.042428 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa61bb-819e-4ab6-be7f-32917b06dffe None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.053247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:44.061232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:44.061564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.063130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 177/360] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:44.063653 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.064495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.065237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.069028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.083648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb18-25dd-4ecb-8eb9-9006eae4c955 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.089067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.089769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.090042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.090305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.091343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:44.092375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.094256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.103281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:44.115926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 178/361] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:44.118083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.125411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:44.133472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 184/362] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:44.139406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.149455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41d35-27bd-447d-9361-20aec1bc533a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.164899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.168580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.169021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.169425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.171452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4166ff-84d8-48f9-b9e0-341a83c802a3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.186564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.190497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.190961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.191395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.195586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:44.196607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.204171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.207407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.209962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.234160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 185/363] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:44.239109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 179/364] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:44.243977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.248834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.274770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd039e4b-ee6f-4ec5-af76-e89476c0194d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.279105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194e720-b518-475c-8384-6500832d6c4d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.291620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.294490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.295796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.296869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.297721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.298371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.299083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.300826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.303350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.312231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.318699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 180/365] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:44.326898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.335338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.343564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.354199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300e07-dce5-44a2-805b-b8b7cdcae066 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.368718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 186/366] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:44.375918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.377875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.378496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.379186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.381472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.383563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:44.383563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:24:44.383563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:24:44.386247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.390749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.398554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 181/367] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:44.407458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.410052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d920e-e780-42b5-93a0-85db9c3e4982 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.418125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.419051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.419323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.419608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.421814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.423967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.426020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 187/368] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:44.438743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7c4e-5b73-4c0d-a95a-3ad3d532a198 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.441254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.449725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.450838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.451333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.451875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.453472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=81db714a86174045bcef3424fe37b717) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:44.454018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.457657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.460410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9067-7bf9-4126-87f6-1e99463d37b4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.470599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 182/369] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=9af319ef09aa4cd69445115653b41037 => generated 260 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:44.474358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.475929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.476425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.476910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.480374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.484363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7d2cb-acfe-48d5-abbf-6d7c7e564d17 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.489346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 188/370] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:44.496783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:44.517140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee429-e538-401d-9dc7-a5d199ab1b8c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:44.531414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:44.533025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:44.533748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:44.534531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:44.536477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=81db714a86174045bcef3424fe37b717) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:44.537327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:44.541592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ce455-1f58-43f3-b6dd-20778c05d911 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:44.556116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 183/371] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:44 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=8eff1ce623524530832effb4e96fb820 => generated 260 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:45.849537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439fdfc-3a78-4588-a327-c150270e7c39 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:45.850326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439fdfc-3a78-4588-a327-c150270e7c39 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:45.850456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439fdfc-3a78-4588-a327-c150270e7c39 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:45.854343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 189/372] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:45.863154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:45.863966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:45.864096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:45.899463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:45.901464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:45.921386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 184/373] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:45.981133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439fdfc-3a78-4588-a327-c150270e7c39 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.012449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439fdfc-3a78-4588-a327-c150270e7c39 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.026785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.028185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.028669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.029159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.053726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:46.067708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:46.070426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 190/374] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:46.079532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.096446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06b5b-362a-4567-97ca-c38506259e4f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.106547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.107841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.108331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.108806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.110273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:46.110830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:46.115128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:46.132341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 185/375] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:46.140976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.160801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6db63-4ed1-4b4b-8251-810457039777 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.168415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.169510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.170004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.170552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.185820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:46.188987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:46.210402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 191/376] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:46.219613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.241683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5df4-c946-4ac7-b412-9e4a8e985953 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.249908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.251409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.252234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.252707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] PATH_INFO: `/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.254903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] RBAC: Authorizing `identity:get_project(project_id=8de7cdc6a1fd4e2da360f0670fd57a70)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:46.258524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:46.262231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 186/377] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:46 2022] GET /identity/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:46.277032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.292303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91024042-7385-476f-90bc-3010107d4eed admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.303688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.305162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.305660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.306151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] PATH_INFO: `/v3/groups/9360efbc489248579566337df3a90083` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.317317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] RBAC: Authorizing `identity:get_group(group_id=9360efbc489248579566337df3a90083)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:46.321316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9569e3-f749-49df-9877-3faf2ab07445 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:46.325212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 192/378] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:46 2022] GET /identity/v3/groups/9360efbc489248579566337df3a90083 => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:46.334456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:46.352643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51fe83-89eb-4310-bc3b-d607ab87d197 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:46.364276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:46.365576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:46.366063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:46.366596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:46.368345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] RBAC: Adding query filter params (group.id=9360efbc489248579566337df3a90083, role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=8de7cdc6a1fd4e2da360f0670fd57a70) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:46.368910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:46.372753 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b6bd9-d7a7-4598-bdb1-5762e73221bb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:46.384838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 187/379] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:46 2022] GET /identity/v3/role_assignments?group.id=9360efbc489248579566337df3a90083&scope.project.id=8de7cdc6a1fd4e2da360f0670fd57a70&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:47.657444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce94a4-4e06-43c6-bf8a-a10297d7e383 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:47.658300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce94a4-4e06-43c6-bf8a-a10297d7e383 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:47.658748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce94a4-4e06-43c6-bf8a-a10297d7e383 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:47.662902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 193/380] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:47.680571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:47.681544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:47.681544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:47.725633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:47.727684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:47.750582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 188/381] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:47.816316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce94a4-4e06-43c6-bf8a-a10297d7e383 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:47.841565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce94a4-4e06-43c6-bf8a-a10297d7e383 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:47.851444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:47.852820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:47.853381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:47.853870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:47.882689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:47.904565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:47.906897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 194/382] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:47.916416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:47.932977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1ca7-a56a-4340-8bcd-1405100e17fb None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:47.949504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:47.950632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:47.953338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:47.953829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:47.955375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:47.955917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:47.958956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:47.983592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 189/383] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:47.992851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.021037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30540d-527d-4ed2-8a35-a2b1e91f1523 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.035395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.036886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.037365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.037851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.040856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.044714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.048192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 195/384] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:47 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:48.056928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.077958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21646-40ad-4307-bf64-75c069c84252 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.087815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.089906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.090771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.091515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.094243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.098549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431d44-c613-440d-97e6-3b99b257a61b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.102702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 190/385] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:48.110342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.136510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324e92a-b32a-4313-bfce-1c222ae1209b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.150280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.151949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.152440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.152938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/groups/d0740314378b487a945099ec3f8911f9/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.162245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, group_id=d0740314378b487a945099ec3f8911f9, role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.167984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929202e-cf76-4994-8743-c31d8417133e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.208748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 196/386] 10.222.0.32 () {58 vars in 1463 bytes} [Thu Feb 10 03:24:48 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/groups/d0740314378b487a945099ec3f8911f9/roles/8eff1ce623524530832effb4e96fb820 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:48.265061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7dbfb-79ad-4073-b05a-217b80283a12 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.265539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7dbfb-79ad-4073-b05a-217b80283a12 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.266025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7dbfb-79ad-4073-b05a-217b80283a12 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.270091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 191/387] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:48.280042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.280501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.280987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.321053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:48.323036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:48.481322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 197/388] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:48.547370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7dbfb-79ad-4073-b05a-217b80283a12 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.579778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7dbfb-79ad-4073-b05a-217b80283a12 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.587167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.588549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.589048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.589460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.617715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:48.632423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6cc99d53-2926-4c2c-8127-a0a6ffb9841a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:48.635884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 192/389] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:48.641396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.665000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba371a-43b4-426f-9ea4-981367d33e23 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.688887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabe03-6278-4d86-8c68-be229501e45c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.689820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabe03-6278-4d86-8c68-be229501e45c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.689820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabe03-6278-4d86-8c68-be229501e45c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.693327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 193/390] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:48.696846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.698134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.698629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.699149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.699394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.699628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.699859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.700580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:48.701122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.704556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.730081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 198/391] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:48.740508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:48.740796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.741703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:48.753399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde202-049d-4295-9bc9-11d6550941b7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.755395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 194/392] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:48.759162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.760398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.760898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.761426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.763037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.765222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.767639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 199/393] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:48.773436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.788722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16958e-f0fb-40f9-b7d8-75c385963f5b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.795164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.796093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.796371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.796639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.803493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.804046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.805619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.807767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 195/394] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:48.813644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.818479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb97a-180f-40e7-bdc1-93fc7b5755b0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.825405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.827491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.828599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.829102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.831739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d78-1bb9-4f70-86c8-83f7759f933a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.842604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.845019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.846646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.847164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/groups/d0740314378b487a945099ec3f8911f9/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.853307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, group_id=d0740314378b487a945099ec3f8911f9, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.857618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:48.861814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.869522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:48.871655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 200/395] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:48.880744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:48.887668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 196/396] 10.222.0.32 () {58 vars in 1463 bytes} [Thu Feb 10 03:24:48 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/groups/d0740314378b487a945099ec3f8911f9/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:48.897542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41cf3c-6bb3-4836-baf1-e3bdbb5c4172 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:48.970909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:48.972094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:48.972664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:48.973231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:48.974353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:48.974956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:48.977004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:48.988616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 201/397] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:48.994548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.008499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dee9f-adbe-4200-afb3-5c6db308cc08 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.014198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.015592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.016152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.016625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.018384 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.020986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.023742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 197/398] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:48 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:49.029926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.042873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85824a8-a1c0-4e03-9c09-89c8ebb5e72e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.048693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.050298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.050899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.051443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.053297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.056154 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ba746-aa56-4894-ae10-153685fd41e0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.059000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 202/399] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:49 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:49.068063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.097401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9ba4-14cf-4171-bdb6-be04617b2dd7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.108419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.109908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.110395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.110912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/groups/d0740314378b487a945099ec3f8911f9/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.117261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2b8773d584d74885a23b2e2f4657c, group_id=d0740314378b487a945099ec3f8911f9, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.122446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0ec71-87e9-40c2-963f-c6f30988abf0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.163257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 198/400] 10.222.0.32 () {58 vars in 1463 bytes} [Thu Feb 10 03:24:49 2022] PUT /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c/groups/d0740314378b487a945099ec3f8911f9/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:49.228247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28139-870d-4b1b-b603-75736a7bc630 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.228581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28139-870d-4b1b-b603-75736a7bc630 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.228971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28139-870d-4b1b-b603-75736a7bc630 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.231367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 203/401] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:49.240476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.241306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.242078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.277352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:49.278561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:49.365494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 199/402] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:49.405196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb28139-870d-4b1b-b603-75736a7bc630 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.419130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb28139-870d-4b1b-b603-75736a7bc630 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.426258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.427267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.427645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.428001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.441931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:49.450177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:49.454874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 204/403] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:49.462571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.472811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd15ab-deea-44d2-b868-d9a3bf19d537 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.481900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.482981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.483403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.483839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.484781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:49.485231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.487130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.499801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 200/404] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:49.506737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.531619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab421-cee0-46cd-8936-0540d1ec4166 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.544979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.546521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.547063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.547523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.553259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.556924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.560442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 205/405] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:49 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:49.565982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.584127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9fe-51ab-4247-bca6-e4089b0904b5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.599460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.600736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.601212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.601676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.603240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.605553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51980180-49d0-4764-a9ba-d4a9ef2bc7e2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.607720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 201/406] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:49 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:49.614393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:49.638501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c93d-ad84-4a83-961d-2e7201bb6add admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:49.653936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:49.655564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:49.656026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:49.656468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717/groups/d0740314378b487a945099ec3f8911f9/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:49.662152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=81db714a86174045bcef3424fe37b717, group_id=d0740314378b487a945099ec3f8911f9, role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:49.667141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955830d-1938-4691-ba0a-8744cb574cae admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:49.708822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 206/407] 10.222.0.32 () {58 vars in 1463 bytes} [Thu Feb 10 03:24:49 2022] PUT /identity/v3/projects/81db714a86174045bcef3424fe37b717/groups/d0740314378b487a945099ec3f8911f9/roles/8eff1ce623524530832effb4e96fb820 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:24:50.141120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfda3-84b7-47bc-b270-9929e4009f8c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.141644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfda3-84b7-47bc-b270-9929e4009f8c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.141644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfda3-84b7-47bc-b270-9929e4009f8c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.143889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 202/408] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:50.149905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.150195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.150474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.178500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:50.179750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:50.257869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 207/409] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:50.297600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfda3-84b7-47bc-b270-9929e4009f8c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:50.315486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfda3-84b7-47bc-b270-9929e4009f8c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:50.320269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:50.321099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.321377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.321650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.336305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:50.343914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:50.345386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 203/410] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:50.351327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:50.362325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e476d-10fa-4092-8c4a-d17bf993b912 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:50.368966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:50.370006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.370482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.371001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.372136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:50.372639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:50.374685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:50.397137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 208/411] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:50.402869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:50.414402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8c67-ddaf-4330-a534-a2110ac654d9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:50.425830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:50.426973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.427341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.427616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] PATH_INFO: `/v3/groups/9360efbc489248579566337df3a90083` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.431461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] RBAC: Authorizing `identity:get_group(group_id=9360efbc489248579566337df3a90083)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:50.433629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:50.435562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 204/412] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:50 2022] GET /identity/v3/groups/9360efbc489248579566337df3a90083 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:50.441690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:50.456705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8442-69d0-4704-a6e9-89f7461f7a65 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:50.465999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:50.467365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.467846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.468313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] PATH_INFO: `/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.475683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] RBAC: Authorizing `identity:get_project(project_id=8de7cdc6a1fd4e2da360f0670fd57a70)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:50.477879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd924-cfd2-4244-bc83-df6033a63118 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:50.480313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 209/413] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:50 2022] GET /identity/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:50.486187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:50.500313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beee36-43f3-4bde-a6bd-3ec3d193a1a9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:50.510637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:50.511579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:50.511854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:50.512125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] PATH_INFO: `/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70/groups/9360efbc489248579566337df3a90083/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:50.520198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de7cdc6a1fd4e2da360f0670fd57a70, group_id=9360efbc489248579566337df3a90083, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:50.522896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409c91e-a8ec-4782-9558-c8568cc7a064 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:50.552926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 205/414] 10.222.0.32 () {58 vars in 1463 bytes} [Thu Feb 10 03:24:50 2022] PUT /identity/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70/groups/9360efbc489248579566337df3a90083/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:24:51.974240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1832-7a19-46b9-80d5-e1cab0512367 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:51.974757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1832-7a19-46b9-80d5-e1cab0512367 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:51.974757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d1832-7a19-46b9-80d5-e1cab0512367 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:51.976512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 210/415] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:51.982321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0b516-625a-459e-bfa7-605352695830 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:51.982896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0b516-625a-459e-bfa7-605352695830 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:51.982967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0b516-625a-459e-bfa7-605352695830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.002710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-68f0b516-625a-459e-bfa7-605352695830 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:52.003912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-68f0b516-625a-459e-bfa7-605352695830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:52.074138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 206/416] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:52.106577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1832-7a19-46b9-80d5-e1cab0512367 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.124858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d1832-7a19-46b9-80d5-e1cab0512367 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.131143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.131965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.132244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.132520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.138287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306d86-ebd1-4743-acce-1e2f08e7b65e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.138578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306d86-ebd1-4743-acce-1e2f08e7b65e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.138955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306d86-ebd1-4743-acce-1e2f08e7b65e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.141349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 207/417] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:52.146668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.146959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.147219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.151496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:52.159079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:52.160933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 211/418] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:52.169611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.179373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:52.180561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:52.188732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420050-6622-4b7c-9203-41bf59106861 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.202850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 208/419] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:52.203650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.204348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.204623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.204896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.205679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:52.205982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.207611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.217184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 212/420] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:52.222840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.232748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3194-cfc0-4146-8594-50fd3bf8dc55 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.243054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.243729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.243998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.244266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.254481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.256353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.259118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.269394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5c98-1342-4a1f-8b0f-0880f3ceb2ee admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.286537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 209/421] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:52.287229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.288068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.288344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.288614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.292881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.313251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeccdd8-bdaa-4ab1-b18b-1c1533cbf934 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.314477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:52.321917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:52.323186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 213/422] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:52.329824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.330205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.331138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.331419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.331693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.332934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.335034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.337055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 210/423] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:52.343262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.344773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b1b6-aea3-4854-be5b-04924ebe8cb1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.353707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a1cf-d44a-4086-89a7-07b04bb0cf75 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.356834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.357596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.357878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.358153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.358464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.358999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:52.359305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.359457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.359654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.359928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.361009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.361292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.363412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.365601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 211/424] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:52.371654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.374463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 214/425] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:52.380570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.384138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924538-c660-4670-b73c-379c4cc07cb2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.391208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.391949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.392283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.392603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.393486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:52.393858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.395950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.397161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822ec3-14e5-489d-9f03-61e274ec6dcc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.403673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 212/426] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=9af319ef09aa4cd69445115653b41037 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:52.407450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.408131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.408462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.408791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.418972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.420892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.431556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 215/427] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:52.440477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.451253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b17c-7dad-4d66-9670-46c132d63f22 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.456210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.457104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.457427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.457697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] PATH_INFO: `/v3/projects/5dc2b8773d584d74885a23b2e2f4657c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.459153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc2b8773d584d74885a23b2e2f4657c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.461388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.463759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 213/428] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/projects/5dc2b8773d584d74885a23b2e2f4657c => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:52.469500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.479635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea005e-e0a1-4d58-b2d1-5108d5e2f4a4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.484578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.485406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.485688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.485969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.487318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.489439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623ff27-95f7-49b3-8f7a-1612c4046196 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.491674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 216/429] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:52.497312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.509113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c60e5-ca7a-42ed-9295-90d7dd815acb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.514076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.514839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.515122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.515397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.516306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=5dc2b8773d584d74885a23b2e2f4657c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:52.516621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.518582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fca73-ba6c-4616-a865-b1b620ca19a6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.531138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 214/430] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=5dc2b8773d584d74885a23b2e2f4657c&role.id=8eff1ce623524530832effb4e96fb820 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:52.786066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ed9e-6f9e-424a-b0fa-04b06a7c48b2 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.786426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ed9e-6f9e-424a-b0fa-04b06a7c48b2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.786903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ed9e-6f9e-424a-b0fa-04b06a7c48b2 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.790542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 217/431] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:52.799476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.799803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.800021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.831875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:52.833886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:52.847340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 215/432] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:52.888092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ed9e-6f9e-424a-b0fa-04b06a7c48b2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.909536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ed9e-6f9e-424a-b0fa-04b06a7c48b2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.914606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.915467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.915747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.916024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.929735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:52.937392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 10 03:24:52.939122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 218/433] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:52.947329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.957044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cc074-6b14-4a5c-bdba-dba9e913e8e0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:52.961761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:52.962455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:52.962793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:52.963078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:52.963819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:52.964436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:52.965848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:52.975894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 216/434] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:52.984951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:52.999163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493941-dd9b-4a11-b34a-d54a03617037 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.004453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.005179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.005451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.005733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.015165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.016965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.028399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 219/435] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:53.038473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.059784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209e81-880d-42b2-a674-1f5e6cfbff2c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.068322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.070292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.071060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.071771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.074318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.078832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.086339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 217/436] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:53.091402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.101438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2036-cdc3-4893-9888-0a2b9260174e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.106400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.107350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.107708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.107984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.109393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.111430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c819c-6f1a-4e56-b4f8-dc41d10298ce admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.113605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 220/437] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.122634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.134198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1926dc7-1fdf-4f77-b729-66873771685b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.139394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.140081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.140362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.140635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.141506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=9af319ef09aa4cd69445115653b41037, scope.project.id=81db714a86174045bcef3424fe37b717) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:53.141819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.143863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4657df-9e69-4f94-aad6-2539fc37dc5d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.151259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 218/438] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=9af319ef09aa4cd69445115653b41037 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.554478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b9cf-552e-4483-ae99-f2364d2f86a6 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.555007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b9cf-552e-4483-ae99-f2364d2f86a6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.555392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b9cf-552e-4483-ae99-f2364d2f86a6 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.557436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 221/439] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:53.565537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7db22-eb47-4e78-ad1b-ef837cb07060 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.565976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7db22-eb47-4e78-ad1b-ef837cb07060 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.566374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7db22-eb47-4e78-ad1b-ef837cb07060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.588841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a8b7db22-eb47-4e78-ad1b-ef837cb07060 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:53.590220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a8b7db22-eb47-4e78-ad1b-ef837cb07060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:53.599680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 219/440] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:53.627020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241b9cf-552e-4483-ae99-f2364d2f86a6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.638118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2862-d0bc-4ccf-8d2c-e2336e1e3648 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.638405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2862-d0bc-4ccf-8d2c-e2336e1e3648 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.638850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2862-d0bc-4ccf-8d2c-e2336e1e3648 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.639839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241b9cf-552e-4483-ae99-f2364d2f86a6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.640589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 220/441] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:24:53.644295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.645142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.645424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.645693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.646351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd083-de73-466e-838b-d4c66af1228f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.646634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd083-de73-466e-838b-d4c66af1228f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.646938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd083-de73-466e-838b-d4c66af1228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.659116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:53.666578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-59afd083-de73-466e-838b-d4c66af1228f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:53.667227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:53.667835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-59afd083-de73-466e-838b-d4c66af1228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:53.669302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 222/442] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:53.674915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.679092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 221/443] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:53.685855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e3f-b375-47b7-a09e-93818eb5c45a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.690567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.691278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.691558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.691830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.692619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:53.692923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.694545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.704276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 223/444] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.705525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd083-de73-466e-838b-d4c66af1228f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.709539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.715454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd083-de73-466e-838b-d4c66af1228f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.720412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.721221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649344c1-90ce-418b-b365-cb3d8afe7217 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.721413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.721561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.721749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.726439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.727236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.727631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.727987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.733063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:53.736684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.738452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.740247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:24:53.741786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 222/445] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:53.747704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.748277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 224/446] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:24:53.756629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.761314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7edf86-56ff-4719-a84f-4ebb1065cee1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.765503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb58a-7617-4ff5-ad27-47ae62c73392 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.765989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.766830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.767236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.767588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.768454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:53.768902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.770174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.770894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.771078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.771358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.771632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] PATH_INFO: `/v3/projects/81db714a86174045bcef3424fe37b717` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.772826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=81db714a86174045bcef3424fe37b717)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.774897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.776596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 225/447] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/projects/81db714a86174045bcef3424fe37b717 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.781503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 223/448] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.782124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.787093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.791900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410843-8715-4e5b-be2f-f292a4e8c0c1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.796494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.797360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.797481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba330e5f-37fa-463d-941b-8cc37dc40b1c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.797638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.797909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] PATH_INFO: `/v3/groups/d0740314378b487a945099ec3f8911f9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.799130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0740314378b487a945099ec3f8911f9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.801041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.802669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 226/449] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/groups/d0740314378b487a945099ec3f8911f9 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.802825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.803639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.803959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.804254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.808862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.813266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.815089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.818262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbe3bb-1955-45fb-85ff-290481699357 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.822790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.823445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.823724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.823996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.824760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 224/450] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:24:53.824914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] RBAC: Adding query filter params (group.id=d0740314378b487a945099ec3f8911f9, role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=81db714a86174045bcef3424fe37b717) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:53.825222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.827320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.830627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.834267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 227/451] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/role_assignments?group.id=d0740314378b487a945099ec3f8911f9&scope.project.id=81db714a86174045bcef3424fe37b717&role.id=8eff1ce623524530832effb4e96fb820 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:24:53.839834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d73b-b86f-48c2-9daa-e02fcea91cb9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.844518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.845424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.845705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.845978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] PATH_INFO: `/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.847373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8de7cdc6a1fd4e2da360f0670fd57a70)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.849238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.851135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 225/452] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/projects/8de7cdc6a1fd4e2da360f0670fd57a70 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:53.857114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.867461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4794f9-d3bb-43d4-908e-a432fb35025a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.872120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.873011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.873316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.873591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] PATH_INFO: `/v3/groups/9360efbc489248579566337df3a90083` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.874951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] RBAC: Authorizing `identity:get_group(group_id=9360efbc489248579566337df3a90083)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.877268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f287-7e93-4a9f-9fbc-8e0a0a2347cc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.879050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 228/453] 10.222.0.32 () {56 vars in 1201 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/groups/9360efbc489248579566337df3a90083 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:53.885322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:53.896048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232ba61-2eeb-4475-8be1-b7666f5fedf5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:53.901343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:53.902114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:53.902454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:53.902836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:53.903798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] RBAC: Adding query filter params (group.id=9360efbc489248579566337df3a90083, role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=8de7cdc6a1fd4e2da360f0670fd57a70) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:53.904188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:53.906172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9c2cd-2686-4e0a-a822-4543a4c9bd71 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:53.913039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 226/454] 10.222.0.32 () {56 vars in 1397 bytes} [Thu Feb 10 03:24:53 2022] GET /identity/v3/role_assignments?group.id=9360efbc489248579566337df3a90083&scope.project.id=8de7cdc6a1fd4e2da360f0670fd57a70&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:57.051829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6b4f-4de3-4bfa-a5a2-ddb1c2d25aff None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.052341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6b4f-4de3-4bfa-a5a2-ddb1c2d25aff None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.052415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6b4f-4de3-4bfa-a5a2-ddb1c2d25aff None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.054486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 229/455] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:57.068936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e51e0-a4ad-46d9-94e6-0b5c896f6af4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.069495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e51e0-a4ad-46d9-94e6-0b5c896f6af4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.069495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e51e0-a4ad-46d9-94e6-0b5c896f6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.092628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2d4e51e0-a4ad-46d9-94e6-0b5c896f6af4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:57.093842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2d4e51e0-a4ad-46d9-94e6-0b5c896f6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:57.106490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 227/456] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:57.118482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8797-c35d-43ed-9abc-15a80223f5c8 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.118801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8797-c35d-43ed-9abc-15a80223f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.119057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8797-c35d-43ed-9abc-15a80223f5c8 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.121110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 230/457] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:57.127445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.127728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.127988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.146420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:57.147653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:57.152465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8797-c35d-43ed-9abc-15a80223f5c8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.164408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 228/458] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:57.179421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8797-c35d-43ed-9abc-15a80223f5c8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.184003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.184810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.185088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.185356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.190588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.202607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910dac-69a1-4ac2-8fc3-579a0cd349a3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.204148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.206015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.217215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.218040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.218309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.218573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.235761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:24:57.237025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 231/459] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:57.245270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.247222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.247792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.265051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001de9-9b35-413c-8957-79429ead585d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.275827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:24:57.277512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 229/460] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:24:57.282774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.283468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.283746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.284017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.284766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:57.285065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.286075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:24:57.286075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:24:57.286075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:24:57.286987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3884-7ef2-4d54-a87f-cd7ecb74bfbf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.290078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.304680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a12d-2110-42e1-b131-34ef74757841 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.314347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.315066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.315340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.315610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.316358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:57.316653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.318302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14072-d190-434b-9346-e9e74863644c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.332578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 232/461] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:57.335988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcad15-8495-4b19-8554-562aac6d8897 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.336266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcad15-8495-4b19-8554-562aac6d8897 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.336536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcad15-8495-4b19-8554-562aac6d8897 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.338612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 233/462] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:57.340623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcad15-8495-4b19-8554-562aac6d8897 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.343584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 230/463] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:57.345730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.346016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.346285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.359160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcad15-8495-4b19-8554-562aac6d8897 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.365097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.365454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:57.366332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.366666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:57.367056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.367623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.368545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.371080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.374843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 231/464] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:57.375922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.388102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ae928-8088-4626-85d6-c4211c7b99db None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.393725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.394767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.395137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.395499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.396343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.398486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.398720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 234/465] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:57.409145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.425181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107050b-b037-4357-a1e2-80053db11ec0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.430148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.431042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.431329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.431780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.445298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.447755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.449995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 232/466] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/users => generated 248 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:57.468410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:24:57.470018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 235/467] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:57.476387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.492923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52757bb-1ebf-4cbf-9c01-bf0697eeaab6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.508646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.509354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.509633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.509900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.510756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:57.511062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.512751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575ad1f-05cf-47a7-8f01-e87214804736 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.534768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 233/468] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:57.540570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:57.558711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3724-f503-4de0-8611-9235d8e02e9f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:57.573910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:57.574997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:57.575486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:57.575959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:57.576946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:57.579187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9e29-decb-4b70-bb1d-06d8334d81b2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:57.617244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 236/469] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:57 2022] POST /identity/v3/users => generated 246 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:58.102873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bbfd0-702b-4470-93b6-30e15ea116ef None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.104422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bbfd0-702b-4470-93b6-30e15ea116ef None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.105189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bbfd0-702b-4470-93b6-30e15ea116ef None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.109351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 234/470] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:58.120906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.122410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.123261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.157042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:58.159570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:58.173729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 237/471] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:24:58.216382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bbfd0-702b-4470-93b6-30e15ea116ef None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:58.237696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bbfd0-702b-4470-93b6-30e15ea116ef None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:58.250213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:58.252461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.253260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.253998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.281033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:58.285168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:58.322492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:24:58.325629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 235/472] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:58.335017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:58.351411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ab56-0731-4146-908b-33e97f2ff1d9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:58.359519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:58.361044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.361826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.362559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.364121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:58.364876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:58.368041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1014dd4-74da-4514-b778-0a7b2f412ccb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:58.390721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 238/473] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:24:58.399662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:58.417682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e53d9-d402-45e4-898a-5b0fc92f08cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:58.425962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:58.427632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.428406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.429177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.430894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:58.435089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cf842-eb6d-4136-8c7b-694e7b24250c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:58.469521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 236/474] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:24:58 2022] POST /identity/v3/users => generated 249 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:24:58.955090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41373168-6a78-43ae-b8e9-d0b5e346d94e None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.955508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41373168-6a78-43ae-b8e9-d0b5e346d94e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.956015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41373168-6a78-43ae-b8e9-d0b5e346d94e None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:58.959797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 239/475] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:24:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:24:58.966183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:58.967162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:58.967890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:59.004479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:24:59.006992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:24:59.021560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 237/476] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:24:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:24:59.047670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41373168-6a78-43ae-b8e9-d0b5e346d94e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:59.081328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41373168-6a78-43ae-b8e9-d0b5e346d94e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:59.091149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:59.092348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:59.092821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:59.093294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:59.094677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:59.097666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:59.112689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.sql.core [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 10 03:24:59.112689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 10 03:24:59.112689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [parameters: {'id': '42cfeb05fc3846ec9686e949ab8afafd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 10 03:24:59.112689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79147) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 03:24:59.134566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 10 03:24:59.137413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 240/477] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:24:59 2022] POST /identity/v3/roles => generated 144 bytes in 91 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:59.143749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:59.167934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7d5f7-5eae-4356-9fed-799e8afc4fc4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:59.184063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:59.186114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:59.186895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:59.187647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:59.216648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:24:59.231762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-8f132d44-0bc8-472a-8168-0085d7580a2b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 10 03:24:59.234684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 238/478] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:24:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:24:59.240584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:24:59.273498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3dac6-4a21-4961-b00d-eb7a9d7e7e6b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:24:59.289823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:24:59.290978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:24:59.291462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:24:59.291941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:24:59.293376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:24:59.293923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:24:59.297071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5f4c4-946a-4538-9a35-ae39dc9376a4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:24:59.324495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 241/479] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:24:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:00.102048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504e1a-6005-481e-9879-596e114425cd None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.102310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504e1a-6005-481e-9879-596e114425cd None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.102690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504e1a-6005-481e-9879-596e114425cd None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.104697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 239/480] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:00.110829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.111300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.111444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.140805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:00.143962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:00.161164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 242/481] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:00.198516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b504e1a-6005-481e-9879-596e114425cd None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.217326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b504e1a-6005-481e-9879-596e114425cd None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.223402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.224229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.224508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.224845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.243062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:00.250536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:00.252511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 240/482] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:00.259074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.275972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6fc9e-0ade-4852-b6ef-f4aff8e7b71d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.291196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.292847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.293602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.294314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.296052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:00.296860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.304350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.324578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 243/483] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:00.330522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.349725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c97326-0bbf-47b0-9fea-32470442b385 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.360273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.361050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.361330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.363583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.389109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.393088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.415784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:00.417381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 241/484] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:00.426443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.456003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44538e-be32-4d0c-bc95-7c5611f11d51 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.468852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.470756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.471513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.472271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.474025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:00.474903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.478330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.506010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 244/485] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:00.514382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.532696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94cb3-84aa-40ce-9f46-bc49902e760b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.540694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.541531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.541807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.542075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.558223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.560468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.583024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 03:25:00.584627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 242/486] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:00.593942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.623404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7234c0-21d6-4918-9a49-c7a022aafbde admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.631778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.633398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.634175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.634940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.636886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:00.637712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.639939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:00.639939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:00.639939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:00.642775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.720229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 245/487] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:00.728845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.763660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef398-0e89-4119-9531-775659aff5cb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.782397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.783553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.784033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.784505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.809595 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.813514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.848337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 243/488] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:00.855546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:00.880954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d064ed-93aa-4845-9878-a0324c86ac56 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:00.893587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:00.895016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:00.895510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:00.895998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:00.934839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:00.938740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:00.979218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:00.981815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 246/489] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:00.990333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.011932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d798-82e4-4250-8f05-43e54ccd1cef admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.025317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.026423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.026908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.027363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.028700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:01.029362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.032481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:01.068182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 244/490] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:01.076715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.099381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06263c59-d8fb-407b-8416-4f217b70263c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.113680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.115070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.115552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.116030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.140373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.144196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:01.173985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:01.176587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 247/491] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:01.185774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.208440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b9e1-12ae-416d-9a94-f7e1d72d47ae admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.221404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.222456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.222949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.223402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.224829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:01.225351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.227172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:01.227172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:01.227172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:01.229249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8eaa-64a6-42ea-8242-f4eb8279b6c3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:01.279002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 245/492] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:01.288622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.318394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa3645-f7ac-4116-a68a-7cce3ed2ba98 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.330752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.331860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.332346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.332822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.334442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=87ef495cf58846848130382884d739e4) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:01.335017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.338603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602919de-54d7-4e08-92b8-aa36bf6ad625 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:01.354355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 248/493] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/role_assignments?user.id=87ef495cf58846848130382884d739e4&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:01.546794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43be8-aac6-478e-a584-eb56eeefbbc0 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.547817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43be8-aac6-478e-a584-eb56eeefbbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.548591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43be8-aac6-478e-a584-eb56eeefbbc0 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.552865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 246/494] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:01.562489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.562985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.563467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.608206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:01.610344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:01.631380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 249/495] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:01.700592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43be8-aac6-478e-a584-eb56eeefbbc0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.739965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43be8-aac6-478e-a584-eb56eeefbbc0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.748268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.750147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.750949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.752054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.784292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:01.798810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:01.801833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 247/496] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:01.808092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.834789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05564-1379-4eb9-9349-db88e9f5ec70 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.850377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.851598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.852089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.852565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.854100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:01.854623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.857993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:01.885035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 250/497] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:01.891003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:01.919094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3c28-639f-4777-b009-245c8982491e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:01.932218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:01.933624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:01.934116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:01.934642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:01.967249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:01.975036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.022470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:02.024862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 248/498] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:02.031668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.064490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318c9b-2854-4acf-8fc5-8f400603fc70 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.075583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.076381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.076668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.076953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.077728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.078039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.079735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6283-04d8-4ee1-bcd3-6c7138515e16 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.097442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 251/499] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.104610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.133147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c95d7c-82b7-4cfa-a259-e6894000c899 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.150345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.151768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.152244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.152720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.177407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.181603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.217371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:02.221507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 249/500] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:02.222262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e612d-4135-4aa7-bb27-2ac9ef7165c0 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.222948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e612d-4135-4aa7-bb27-2ac9ef7165c0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.222948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e612d-4135-4aa7-bb27-2ac9ef7165c0 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.224745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 252/501] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:02.231846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.243917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.244178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.244485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.253829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08540e6-47d0-4c58-8beb-dddbebf73520 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.273592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.275187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.275966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.276670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.278470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.279410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.282506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:02.282506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:02.282506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:02.285460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.300726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:02.303103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:02.337062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 253/502] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:02.389601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 250/503] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.395541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.418730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c238c-a3e7-4d4b-b5b9-4290fd352d27 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.427335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.428852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.429649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.430434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.461010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.465202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bcb0a-1894-48fd-82a7-056bac8b1e92 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.470674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.498102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485d62-ad44-4147-9d36-7e12e01e60fb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.504869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 254/504] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:02.508180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57b4ac-69c8-4056-91d5-9deffb1dabcf None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.508970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57b4ac-69c8-4056-91d5-9deffb1dabcf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.509117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.509926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57b4ac-69c8-4056-91d5-9deffb1dabcf None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.510839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.511331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.511876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.515095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 255/505] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:02.516759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57b4ac-69c8-4056-91d5-9deffb1dabcf None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.540261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:02.547308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57b4ac-69c8-4056-91d5-9deffb1dabcf None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.555150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.556725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-9956703a-cda3-4b1b-81a5-7f8e9d6ed914 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:02.557170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.557945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.558694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.559430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 251/506] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:02.562045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.562520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.563067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.579815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.583913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.594779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:02.596794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:02.610795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 252/507] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:02.611995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.618848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:02.621926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 256/508] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:02.628454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.649162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d4921-b517-44be-b58c-8825e9433b85 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.661545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff637f5-c60c-4bc8-b5c3-22272773b14f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.668452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.668452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.668452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.668452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.668998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.668998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.671836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.678292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.679295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.679779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.680249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.681194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.681699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.688931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.689113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 253/509] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.690353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.708507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f77d2-aa3c-4b57-8b9d-e63ee9768e7e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.716173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.716543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 257/510] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.717581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.718082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.718186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.718556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.736105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515048ec-a755-4b43-bee7-27a20764b540 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.736659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:02.743589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.744933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.745417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.745890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.751302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:02.754266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 254/511] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:02.755752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.773698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32d5c-5f5f-4c8b-a259-71d20d5adec1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.774305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.777644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.781431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.782859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.783354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.783824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.796429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.800115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.812761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:02.815048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 258/512] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:02.816478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.825895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:02.828173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 255/513] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:02.829620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.842142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a18e-612b-44ff-a952-3be52c7bc7ad admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.848297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dc8e1-ca56-49c0-bd21-7460996ecc3b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.849771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.851143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.851800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.852284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.853880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.854412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.855806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.856939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.857529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.857857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.858015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.859377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.859878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.862882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.882371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 259/514] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.884231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.884421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 256/515] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.887305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.907655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cb4a-850e-46e1-8e91-5fef9242c137 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.913638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eddbf6-912c-4039-846e-bb8c67d4478f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.915432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.916679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.917236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.917715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.919316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:02.920256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.922278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:02.922278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:02.922278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:02.924548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.924751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.926644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.927188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.927877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:02.949792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:02.953406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:02.960015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 260/516] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:02.961542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.980396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd93a5-4760-4d9a-9367-74c32e475c8c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:02.986701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:02.988215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:02.989426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 257/517] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:02.989648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:02.990858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:02.995247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:02.995778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.009727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de612b-1756-4933-a3e1-bc55cb25aff1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.013633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.017339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.017865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.018418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.019129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.019606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.021158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.021721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.025438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.036585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 258/518] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.038036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.049021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 03:25:03.051625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 261/519] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:03.062717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dc467-06cd-4731-888e-e5ca76425a03 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.071312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.071866 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.072520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.073049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.073535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.075013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.075496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.078526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.093377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410e18c-2c76-4083-a989-90a5594654ca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.108576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.112597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.113217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.115185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.120651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.121342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.128006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 259/520] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.129209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.137180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.168349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c489-3711-4b72-8933-c63b81ef85f1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.187791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.189171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.189703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.190115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.198738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 262/521] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:03.208074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.221917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.221917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.230322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934583-b318-4205-a85d-31111b92f73f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.245430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.246522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.247029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.247540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.249621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 03:25:03.253415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 260/522] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:03.262291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.268502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.271938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.283913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26fe73-172c-4db9-873c-a950ce86e06e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.291553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 263/523] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:03.292325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.293244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.293719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.294210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.299358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.300027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.300949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.302399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.318685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c85-479a-43d6-9623-a79fac3ac6d9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.334679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.334679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.334679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.334679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.335977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 261/524] 10.222.0.32 () {56 vars in 1160 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.351761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.356556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.359842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.375228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628a08e-2b3b-4925-b0fb-2583db46c62c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.384646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.385709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.388502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.389087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.395964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:03.401298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.402890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 264/525] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:03.403969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.408089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.416229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 262/526] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:25:03.425410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.431776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52fd2c-b0b7-44d0-9d79-bd8b8148766a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.435541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621a0f8-3f1b-45da-ba5c-187d91374a4f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.440693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.440859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.441884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.442216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.442385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.442944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.443425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.445132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.446218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.446798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.449811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.458364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.460671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.474046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 265/527] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.483206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.492014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-83105c8b-8dfd-49f0-a429-928a9e9658f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:03.493918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 263/528] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:03.508043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa79ca6-cbc7-41d8-8245-bc532e1dd20d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.514278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c396-8a6a-4c43-894b-d047739e47a9 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.514573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c396-8a6a-4c43-894b-d047739e47a9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.514941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c396-8a6a-4c43-894b-d047739e47a9 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.517067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.517273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 264/529] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:03.517985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c396-8a6a-4c43-894b-d047739e47a9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.518606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.519260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.519752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.533853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c396-8a6a-4c43-894b-d047739e47a9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.534424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.539031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.539540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.540331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.540672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.541012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.541914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.542286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.544127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcca62-afe5-4142-a6c6-7fbf50a12b3b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.558106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 265/530] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.559660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.560133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.560518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.566875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:03.568305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 266/531] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:03.569014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.587797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4decd-7690-4f83-bec8-e303e7d31f5a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.594342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.595570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.595855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.596130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.601104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:03.603588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:03.604320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.606379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.618334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 266/532] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:03.619809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.621564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:03.623182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 267/533] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:03.635410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.644552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5797bf-c8b5-4a17-bd5c-82592d60267c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.649417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0d4f-0aa2-400a-bcd0-ea96ce3596f3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.654320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.654713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.655093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.655376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.655652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.656040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.656498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.656667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.656808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.657108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.658808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.659041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.659374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.664334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.679784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 268/534] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:03.680947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.700436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 267/535] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.701779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.714192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8aaed-493e-4256-a922-83a6608e2be0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.717533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7746-cbca-4db7-b42f-51e5f172a9bf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.722713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.723185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.724059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.724181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.724572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.724885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.725051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.725557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.726630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=8f0955fb6d7347afb65d3acec567eb1c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.727223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.729465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.736484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 268/536] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/role_assignments?user.id=8f0955fb6d7347afb65d3acec567eb1c&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.737654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.754857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.757536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab991-0ce2-4455-a057-1ef660d09db9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.760693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.769455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.770568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.771020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.774562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.775824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=12399215913a4d619dc6be7f0c037347) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.776298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.778340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.793290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:03.795440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 269/537] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/role_assignments?user.id=12399215913a4d619dc6be7f0c037347&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.797176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 269/538] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:03.803879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.820723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84739b-f16c-4484-9ff2-978f342d27b1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.836831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.836831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.836831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.836831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.838092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:03.838530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.841254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7ba3-fb5b-4919-8ecb-661cd67ae335 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.876852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 270/539] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:03.885069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:03.913612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb689492-f0e3-4033-94ca-1f48b6b5dd19 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:03.921048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:03.927669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:03.928403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:03.929044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:03.930381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:03.934031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea415d50-aab9-410a-94a2-b6f58a2d9569 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:03.980387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 270/540] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:25:03 2022] POST /identity/v3/users => generated 247 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:04.779063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443213-da4b-4684-a4f2-d02c98d2c79f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:04.779940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443213-da4b-4684-a4f2-d02c98d2c79f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:04.780361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443213-da4b-4684-a4f2-d02c98d2c79f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:04.784598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 271/541] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:04.791155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:04.792106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:04.792106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:04.828635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:04.830805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:04.856238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 271/542] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:04.897517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39443213-da4b-4684-a4f2-d02c98d2c79f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:04.929396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39443213-da4b-4684-a4f2-d02c98d2c79f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:04.945477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:04.947834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:04.947834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:04.947834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:04.981142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:04.995330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:04.997912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 272/543] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:05.004745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.026245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b07075-1943-41bb-9c52-d37907bf9e66 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.037516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.038561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.039068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.039546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.041002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:05.041538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.044810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.065892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 272/544] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:05.071958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.089860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358efd6-a944-43ff-8ca2-adbcf5048840 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.106154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.107589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.108065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.108532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.141664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.145552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.182357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:05.184858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 273/545] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:05.191006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.216761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033e5d-01bf-4f0f-b8ff-29fcdf2cb72f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.223849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.225374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.226138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.226970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.234840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:05.235307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.237003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.261513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 273/546] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:05.268008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.297138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3923a5e-96b2-411c-a287-0b0990b2c091 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.305993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.306867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.307161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.307419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.325602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.327786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.350758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 03:25:05.352340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 274/547] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:05.358030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.372389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570bbdb-955b-4583-a7b6-077e43ca00e9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.384190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.384885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.385167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.385598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.386493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:05.386833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.388805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.422883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 274/548] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:05.428036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.448496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca938-9b58-4d77-8743-8e951e73c7a4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.464939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.465768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.466055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.466329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.486585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.488493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.509874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:05.511557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 275/549] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:05.517134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.532781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68d128-a4f5-4806-81c2-3bc2b2803d37 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.541446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.542217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.542506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.542867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.543634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:05.543927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.545640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.562679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 275/550] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:05.567899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.584490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bed4cb-ba03-4935-aea0-64f07406f7a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.592334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.593167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.593449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.593705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.608250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.610259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.627708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:05.628961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 276/551] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:05.634943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.656986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ed72-5332-4137-a86c-74bc090c77fd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.661317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.662001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.662288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.662569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.663413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:05.663724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.668125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e0e3-13cb-465c-b608-016441a737f7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.697477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 276/552] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:05.703238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:05.716167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e1a11-a31c-4c57-b225-28b18dba637b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:05.723023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:05.723935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:05.724192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:05.724470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/87ef495cf58846848130382884d739e4/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:05.748634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=87ef495cf58846848130382884d739e4, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:05.751341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa191301-578d-4686-a614-a3f6ca3694ce admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:05.783081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 277/553] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:05 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/87ef495cf58846848130382884d739e4/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:06.712262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd47e-aa25-46ac-9d4a-80f016ca5780 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:06.713068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd47e-aa25-46ac-9d4a-80f016ca5780 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:06.713068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd47e-aa25-46ac-9d4a-80f016ca5780 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:06.715095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 277/554] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:06.730993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:06.731273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:06.731540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:06.770699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:06.774688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:06.943574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 278/555] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:06.990459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bd47e-aa25-46ac-9d4a-80f016ca5780 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.029631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bd47e-aa25-46ac-9d4a-80f016ca5780 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.040349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.041752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.042257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.042775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.072219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:07.100416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:07.102685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 278/556] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:07.109495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.125986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7655d8-5ec2-4a2a-99c5-09eccb3b0bc6 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.141601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.142795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.143291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.143781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.145219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:07.145770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.148945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.170486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 279/557] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:07.176242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.206628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc25f4-dae9-4deb-ab47-18f7cd6455bd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.217203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.218601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.219121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.219608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.249322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.253373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.294431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:07.301166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 279/558] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:07.307849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.335185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0e2c-1c1c-4778-ad30-b2cf2e259c07 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.350910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.352083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.352583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.353058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.354473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:07.355058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.358529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.392740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 280/559] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:07.398468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.426890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fef6-c650-49c7-a769-7a8b354c5c32 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.441454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.442848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.443344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.443824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.468914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.472962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.510369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:07.516848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 280/560] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:07.523159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.549217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e845-74ec-4e70-befa-fd8f91730de5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.564114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.565411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.565895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.566356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.568156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:07.568801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.572706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.627170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 281/561] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:07.634133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.652710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e878b-dbd3-44ea-bd56-30824d8320fb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.667509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.668768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.669284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.669822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.695762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.697665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.721796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:07.729331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.731042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 281/562] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:07.762577 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0271-5a51-44cb-abe4-3d8fff666b5e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.780040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.781152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.781637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.782182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.783650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:07.784183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.787500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec497-e3a0-4fd2-86ac-16130daeb1a6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.821556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 282/563] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:07.826525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.844298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32fb57-3209-409d-b819-e3d0bb563eb2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.859536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.860396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.860679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.860958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.872018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.874179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.889290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a91c-af83-477d-8b6d-437b0a4456b0 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.889752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a91c-af83-477d-8b6d-437b0a4456b0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.890230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774a91c-af83-477d-8b6d-437b0a4456b0 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.894886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-5db9c830-2962-4963-afbb-f8999c54c280 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:07.896383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 282/565] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:07.896630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 283/565] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:07.902075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.902442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.902697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.902926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774a91c-af83-477d-8b6d-437b0a4456b0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:07.941350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774a91c-af83-477d-8b6d-437b0a4456b0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:07.953435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:07.954969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:07.955871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:07.957385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:07.958146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:07.958884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:07.960670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:07.961582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:07.970683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:07.974062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 283/566] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:07.995700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 284/567] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:08.002478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.002922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.019843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a76e-952f-40ce-acd7-33e92efa601b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.027349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.028744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a350f-880e-420d-97ad-18f1b6fa022f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.029183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.029822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.030486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.051393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.051988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:08.052305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.052579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.052845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.067619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:08.070707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 285/568] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:08.079542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.096442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=74c6cf5d4bba4126a0a94a4db29dee52, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.099606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adaa61-cf24-4ab9-9614-898435465dea admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.101830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2626-cc61-4047-92e2-56ef38d2718b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.107295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.108774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.109513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.110265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.111610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.112250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.114532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.129867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 284/569] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:08 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:25:08.130684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 286/570] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:08.132387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45f46-d490-446c-9706-85fb4f636ee3 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.132953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45f46-d490-446c-9706-85fb4f636ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.133466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45f46-d490-446c-9706-85fb4f636ee3 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.136428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.137022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 285/571] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:08.157068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fccc-cc1c-4507-933e-a34c0cf6d0d6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.157581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fccc-cc1c-4507-933e-a34c0cf6d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.157966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fccc-cc1c-4507-933e-a34c0cf6d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.166559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfb0cc-2368-461b-80ee-8cdcee1e7f9a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.200571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4e10fccc-cc1c-4507-933e-a34c0cf6d0d6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:08.202997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4e10fccc-cc1c-4507-933e-a34c0cf6d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:08.278582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.280652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.281440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.282265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.302374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.306431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.314213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 286/572] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:08.314213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540357f-f84a-44c2-bd35-50fb4d3e57b6 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.314213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540357f-f84a-44c2-bd35-50fb4d3e57b6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.314213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540357f-f84a-44c2-bd35-50fb4d3e57b6 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.322786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 287/573] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:08.326152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.326641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.327148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.342606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:08.344782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 287/574] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.352460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.360338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:08.362177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:08.371311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561b242-6a81-47bd-9f00-3e801a35c7a5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.377758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 288/575] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:08.378138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.380822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.382107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.382827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.383445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.384875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.385536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.388636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.394133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c343-aeac-42a1-bc25-647046370407 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.401851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.402549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.403134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.403594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.412401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 288/576] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.414160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.422336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:08.430735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1353-a9e5-4cde-a917-96c2dc6e7694 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.436136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:08.438287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.438695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 289/577] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.440024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.440323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.440950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.441613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.456546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50fabd-1dda-447f-90c3-b38e28e8631e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.463813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.464281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:08.465057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.465527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.465979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.478126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:08.480041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.481143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 289/578] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.482923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.483919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.499400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a7525-9743-4d33-9d19-b72122a7d94c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.507105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.508503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.509164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.509861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.510029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 03:25:08.511554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.512245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.512494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 290/579] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.513776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.516187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.530752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc659da-175e-4b8b-bf1b-2fce61d8e2d1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.532699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 290/580] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.534556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.539074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.540340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.540899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.541421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.542771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.543311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.546152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.553925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35946f9-9eaa-4c01-b1b0-236d7eef03fc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.561162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 291/581] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.562299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.562483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.563841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.564530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.565209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.567145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.567979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.571720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.578885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865731-e298-4b31-8a7f-a76793dced28 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.585959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.587249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.587723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.588287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.606617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 291/582] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.606927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.608615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.610232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.625195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0389b-e7f8-414e-a8d4-9a52379f0b11 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.632757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.634286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.634970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.635580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.642537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:08.645070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 292/583] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.646449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.655097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.658729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.663431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56550bdf-afc4-418b-9bc5-d453b3b2bd5d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.675082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.677409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.677409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.677409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.691262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:08.694188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 292/584] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.696048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.706877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.709651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.713212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3e46e-cbed-448f-8a91-1a3bd573bd84 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.720608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.721949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.722587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.723235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.724699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.725404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.728413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.740814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:08.742836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 293/585] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.744151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.751053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 293/586] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.753178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.761784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9bd-3db8-49c0-942b-5f8b35c9b139 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.768891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.769963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.770416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.770906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.771217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333b072-2051-4f87-9f54-74e6d9624061 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.772172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.772795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.775942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.779079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.780357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.781074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.781725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.783200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.783877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.786938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.797619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 294/587] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.799114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.809172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 294/588] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.811185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.815452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1362c4-1267-43e3-95d0-dce81ed023ed admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.822416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.823690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.824157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.824611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.829018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa1e4-3e2c-4123-a793-1d91d6af7c54 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.836279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.837820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.838457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.838616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.839282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.842211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.852737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.857126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.867162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 03:25:08.869569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 295/589] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.871034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.884245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:08.886702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 295/590] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.888641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.889143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52ae1-daba-4250-bc28-926d8b911e77 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.896862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.898270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.898880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.899391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.907570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284061aa-bf60-48e5-ab0e-681d44c33340 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.914589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.915609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.917039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.917725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.918361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.918610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.920453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.921219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.924875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.944074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:08.946144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 296/591] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:08.947710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.960119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 296/592] 10.222.0.32 () {56 vars in 1160 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:08.962571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:08.968128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd1c9b-fb58-4315-b9f2-8e81f3701608 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.975945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.977101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.977561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.978066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.979869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.980389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.981550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f0d2-dfb4-4061-9a07-0b61f8306c0e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:08.984327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:08.989484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:08.990944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:08.991612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:08.992321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:08.994012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:08.994802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:08.998517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.019395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 297/593] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.020825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 297/594] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.021072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.029630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.039022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e51-e849-4b49-9850-b6431868bea0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.041553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb4c8-6cbd-4baf-9c0f-6ec08aea0aa8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.046553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.047508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.047755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.048177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.048589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.049606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.050130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.050712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.058897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.061197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.071545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.074325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 298/595] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:09.075313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.075629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.095557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73842-bfa3-4f54-932c-1ed9cc400741 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.103156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.104841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.105458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.106029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/12399215913a4d619dc6be7f0c037347/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.107040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:09.109716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 298/596] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:09.111167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.128677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4b8e-a7d7-45b7-a932-8f5ccf2b1d08 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.134933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=12399215913a4d619dc6be7f0c037347, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.135670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.136896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.137347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.137803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.140171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.158609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.162330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.165907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 299/597] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:09 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/12399215913a4d619dc6be7f0c037347/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:09.167909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.192956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:09.195487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 299/598] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:09.206905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.226332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518142b-9f94-43cf-9e87-ce53e048c018 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.257235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bd96-0242-4acf-89ce-0fce7764d300 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.272346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.274025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.274990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.276292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.277300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.279703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.281754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b90cf-5124-4374-8630-d53837c2b646 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.295438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 300/599] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.296802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9293aa-21bf-4920-9353-c2e87ee3c3c4 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.297117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9293aa-21bf-4920-9353-c2e87ee3c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.297368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9293aa-21bf-4920-9353-c2e87ee3c3c4 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.306221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 301/600] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:09.306221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9293aa-21bf-4920-9353-c2e87ee3c3c4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.331803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9293aa-21bf-4920-9353-c2e87ee3c3c4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.342109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.343564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.343856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.344112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.348870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.349567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.349845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.350129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.351254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.351254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.352932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ffa8-db8e-4fd5-8f74-c83a1c7d9b7c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.362041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.367708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.375354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 300/601] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.378570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.379105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.379670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.402943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:09.405888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 302/602] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:09.408549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.415415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:09.417560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:09.428561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93364af-da73-4cda-82bb-ca35b9fa5e2f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.432749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 301/603] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:09.438680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.441394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.443089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.443829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.444547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.458683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a680-f84e-44ef-baff-780d8958ff0a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.468710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.472908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.475605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.476146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.477751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.478424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.480749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.481292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.488541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.510843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 302/604] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.518460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.518987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:09.521897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 303/605] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:09.523509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.545752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ed286-031f-4db6-8802-a557a6cfc328 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.546854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda577a-a4b0-488d-9e2a-a230521f7d2e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.552900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.554509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.554995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.555448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/8f0955fb6d7347afb65d3acec567eb1c/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.556517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.558313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.559145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.560161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.580845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=8f0955fb6d7347afb65d3acec567eb1c, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.582132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:09.585889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.596160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:09.599438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 303/606] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:09.606450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.617876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 304/607] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:09 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/8f0955fb6d7347afb65d3acec567eb1c/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:09.618972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.629842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06d45-0819-48f4-8763-f37b1b14e39e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.809489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64742d-f139-4968-9362-c1c3721defcd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.823555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.824716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.825214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.825692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.827536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.828086 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.831985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.835462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.836171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.836448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.836735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.837520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.837824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.839546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.856035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 304/608] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.858621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 305/609] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.867468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.867699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:09.890580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583592b6-21b7-4ca5-9575-60a76d58c0e4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.892353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6daecf-686b-4f53-a58b-506566aaec56 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:09.906228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.907295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.907726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.908153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.909570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b2e93de4f4c34d25bbb086fc94bca1d8) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:09.910056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.914411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:09.915722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:09.916167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:09.916594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:09.930200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.944439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 305/610] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/role_assignments?user.id=b2e93de4f4c34d25bbb086fc94bca1d8&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:09.946152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:09.949799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:09.979608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:09.981908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 306/611] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:09.992538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.009453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0c08-f496-46dc-bd41-b3520b4dd8fa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.018346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.019417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.019865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.020269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.021401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:10.021857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.024502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.050171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 306/612] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:10.058317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.073641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e9f9-59c0-4fda-9af5-f1676da5e950 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.088308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.090337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.091189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.092071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.116316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.121253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.162320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 03:25:10.170703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 307/613] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:10.174611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.202988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d51-95b1-4f63-b963-30f0c1f2e153 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.217046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.217749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.218030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.218297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.219209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:10.219514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.221443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.257568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 307/614] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:10.265961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.292133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003d80b-2572-4abe-abba-79ba88ba9649 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.314010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.315860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.316615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.317361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.340505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.341794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.353077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 308/615] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:10.362301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.391656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c7d14-22af-4ddd-ad36-c9eaeb042d94 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.405444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.407427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.408189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.408944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.428960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.433035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.467469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:10.470546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 308/616] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:10.478201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.497312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bc4c8-5ec8-4093-a733-ca6cfad678b5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.508297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.508987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.509278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.509549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.510270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:10.510573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.512238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.532973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 309/617] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:10.542222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.564574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60834b07-ad02-49e8-bab0-87caa46a8a5a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.581296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.583511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.584549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.585363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.603756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.608716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.646040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:10.648868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 309/618] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:10.657435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.689965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09355e65-e69d-4fff-9499-13a1990197c2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.708630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.709327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.709605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.709876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.710739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:10.711046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.713008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c082e2-16da-4a6d-857d-5342752844f2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.741357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 310/619] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:10.751245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:10.780735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bbd9f-6a6d-466f-8fc5-bfc4ab37d7f7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:10.792858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:10.794751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:10.795567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:10.796438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:10.798686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=87ef495cf58846848130382884d739e4) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:10.799634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:10.803939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb5b9-486a-463c-9e88-6902e8515eb9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:10.820833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 310/620] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:10 2022] GET /identity/v3/role_assignments?user.id=87ef495cf58846848130382884d739e4&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:11.121784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8171-e7db-4f31-8baf-95e39880759e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.123425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8171-e7db-4f31-8baf-95e39880759e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.124140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8171-e7db-4f31-8baf-95e39880759e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.128768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 311/621] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:11.139086 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.140713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.141535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.182994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:11.185151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:11.202697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 311/622] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:11.247249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8171-e7db-4f31-8baf-95e39880759e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.278387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8171-e7db-4f31-8baf-95e39880759e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.286875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.288073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.288667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.289212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.314551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:11.327909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:11.330850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 312/623] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:11.340426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.360794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a88073-efb9-449e-bc06-6e589e09864e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.371006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.371737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.372096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.372298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.373715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:11.373715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.375202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.390677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 312/624] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:11.398687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.421538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c891-b5a2-4975-9c2c-9b2102cb3890 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.430606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.431455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.431732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.431998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.452211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.454414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.480992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:11.491204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 313/625] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:11.504582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.520554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4967e-b23c-417d-87fc-531b40ea8640 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.530365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.531203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.531482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.531764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.532574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:11.532909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.534619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.556722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 313/626] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:11.565625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.580481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb0fe-9ea7-4aef-bec6-b056cabb503c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.590382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.591227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.591553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.591869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.608033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.610091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.629913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:11.631409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 314/627] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:11.639945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.656092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2820a-c691-464d-a118-cd96c3ef8dbb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.665789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.666506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.666818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.667102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.678703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:11.678703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.678703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.710871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 314/628] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:11.719077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.736351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad951-177a-4fe3-916c-10a72bc6c791 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.744608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.745265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.745535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.745799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.759467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.761227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.777176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 315/629] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:25:11.785728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.800041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69a4a-2897-4014-af20-1e6b634c00c2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.809822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.810737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.811028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.811304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.828820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.830707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.851565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:11.854392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 315/630] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:11.861520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.874359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba20c-135a-4494-bfe6-f6424239ff90 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.882489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.883105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.883434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.883697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.884356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:11.884650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.886250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.900955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 316/631] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:11.906685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.917056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85559c2-95cf-4f5c-854e-021794219896 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:11.922840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:11.923674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:11.923949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:11.924219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:11.932112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:11.934112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:11.949570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:11.951322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 316/632] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:11.957954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:11.984318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90593a2e-5e46-4fcf-9b6a-5cbe42d2d454 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:12.000688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:12.002593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:12.003336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:12.004055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:12.005757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:12.006569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:12.010214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca6a16-71bc-40ed-8945-e5ba70f57b03 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:12.032896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 317/633] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:12.038553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:12.056704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6427e-afd1-48c4-99d9-66159e52456b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:12.072564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:12.073265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:12.073552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:12.073803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:12.074690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:12.075000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:12.076960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa16a9-f809-4537-a5b2-fb9041bc3bb5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:12.084108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 317/634] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:12 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:12.987995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ee9c-221a-4ab0-bacd-2282d45b6c8c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:12.988520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ee9c-221a-4ab0-bacd-2282d45b6c8c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:12.988520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ee9c-221a-4ab0-bacd-2282d45b6c8c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:12.990574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 318/635] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:12.997635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:12.998142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:12.998701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.034005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:13.036436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:13.051998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 318/636] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:13.078825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ee9c-221a-4ab0-bacd-2282d45b6c8c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.096947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ee9c-221a-4ab0-bacd-2282d45b6c8c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.101786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.102638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.102989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.103263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.116892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:13.124240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:13.130864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 319/637] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:13.133002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.151967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679ab1f-5371-4302-a382-18eafa3dfa17 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.159160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.159864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.160146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.160431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.161222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.161534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.163219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.179608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 319/638] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.185655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.200479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111bac6-aa86-4907-8bae-28414afb498d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.208554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.209424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.209705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.209976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.227385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.229349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.252020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:13.253399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 320/639] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:13.259293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.269838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf39a-67db-45dc-bdd5-d0b1433b99b1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.274589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.275302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.275587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.275864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.276607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.276913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.278523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.296735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 320/640] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.298206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.308592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062143-590e-4bad-a545-0f95f7c5bd96 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.313298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.314114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.314390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.314730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.322778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.324840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.340439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:13.346442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 321/641] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:13.347974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.362602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e079c4-5d9c-4301-b743-73ea42419da5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.372910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.373617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.373898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.374173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.375078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.375389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.377649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b4a8f-513f-44db-8444-9004827726cf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.406804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 321/642] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:13.412165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.429254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac01c4-dbc4-4a3b-876f-b0c9e644be20 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.445308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.446739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.447234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.447702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.454175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5fe0-cd09-4ad9-858d-be6755229f81 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.454644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5fe0-cd09-4ad9-858d-be6755229f81 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.455179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5fe0-cd09-4ad9-858d-be6755229f81 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.472098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 322/643] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:13 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:13.474631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd626-f95e-4daa-b369-e446b8f2efa4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.475190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd626-f95e-4daa-b369-e446b8f2efa4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.475671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd626-f95e-4daa-b369-e446b8f2efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.494099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.498220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.529842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-de7cd626-f95e-4daa-b369-e446b8f2efa4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:13.531324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-de7cd626-f95e-4daa-b369-e446b8f2efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:13.540839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 323/644] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:13.542559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618a-5da4-4cf9-b615-c95df771b8a9 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.543142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618a-5da4-4cf9-b615-c95df771b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.543635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618a-5da4-4cf9-b615-c95df771b8a9 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.546134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 324/645] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:13.552232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.552500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.552770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.553247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:13.555871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 322/646] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:13.562944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.577088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:13.578275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:13.590196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b54d-1f41-405f-8a0e-78815295c6ed admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.590757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 325/647] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:13.602995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.604202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.604730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.605216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.606695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.607265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.610351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.611060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.620712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218f478-0c07-4d29-b820-967c25e16e7c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.625548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.626374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.627040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.627316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.639157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:13.645159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 323/648] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.651146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:13.651303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.654424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 326/649] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:13.655338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.669238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84679ad-6d89-4625-858b-549d17514f2c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.669606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2faa-ee03-49c0-860d-d38e6f8685a8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.674080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.678676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.678676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.678676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.679624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.680810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.681297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.681836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.685093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.690110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.700498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:13.706315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:13.706604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 327/650] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:13.708072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.720821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:13.723255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 324/651] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:13.724674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.724904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d410a6-5446-4605-b557-be023471bad9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.742352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.743498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.744023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.744493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.745928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.746519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.750109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.750457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1c62-d1c3-43ae-bce8-b663ff512699 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.758743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.760133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.760803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.761488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.763335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.764112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.768076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.768368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 328/652] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.769998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.784514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dd33f-3e49-4357-9fb0-c6e0e459a716 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.789741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.790487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.790813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.791087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.791910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:13.792216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.793967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.795293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 325/653] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.797017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.809039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 329/654] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:13.810051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.814857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2095-86ff-4537-a815-63d448055368 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.820918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095bde-f7f3-4795-8cda-fb5e64810fa5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.823573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.825842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.826072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.826772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.827074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:13.827353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:13.827686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b2e93de4f4c34d25bbb086fc94bca1d8/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.828068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:13.845603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=b2e93de4f4c34d25bbb086fc94bca1d8, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.848468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.848717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:13.852792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:13.870820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 330/655] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:13 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b2e93de4f4c34d25bbb086fc94bca1d8/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:13.871929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.888607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:13.891102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 326/656] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:13.898850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:13.920205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147e8ed-b7f2-4f06-97a2-3fa20bec9f06 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:13.998177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:13.999704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.000725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.001359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.002816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.003324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.005452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.020087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 327/657] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:14.029009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ef6a-c88e-4142-9727-3e816532c6ff admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.029933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.041633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceec75-c0ff-4e3c-9697-aa4d677039f0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.046335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.047203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.047486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.047758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.048921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.050256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.050776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.051285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.057635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.060258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.077441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 10 03:25:14.079502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 328/658] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:14.085155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.094108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.097524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22013-bcb7-420b-95f5-b93ea4de2a0b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.097880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.102983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.103951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.104432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.104847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.105953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.106450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.108767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.131672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 329/659] 10.222.0.32 () {56 vars in 1158 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:14.138783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.150570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:14.152956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 331/660] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:14.157968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1988b-0fb6-4d16-852b-76fbb82316c7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.159325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.164156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.164820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.165148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.165426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.172878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503ce12-0f7c-4bd8-896d-740180e8446c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.176679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.178747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.185335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.186025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.186297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.186581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.187357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.187667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.189282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.196995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 330/661] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:14.202497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 332/662] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:14.203292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.214356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ccbd-5512-4677-9aea-cbb54174a426 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.215726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.219387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.220203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.220484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.220754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.228976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f064f-8999-408b-9e9f-2da17b0f3d38 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.234269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.235617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.236445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.236979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.237466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.237946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.251164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.254006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.258467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:14.260115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 331/663] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:14.265876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.271373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 10 03:25:14.274205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 333/664] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:14.276779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b422-eff8-4f32-a616-f7bcd37be5c4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.281424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.282202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.282551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.283005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.283342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.283972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.284341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.286073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.296616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf7228-25c9-418d-bdbe-95813559e03a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.299487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 332/665] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:14.302280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.303251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.303717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.304520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.305277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.305883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.306369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.308448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.316580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912e45-b586-4ca5-a8af-fb72aee567e7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.321573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.322525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.322894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.324145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.331562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.333753 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.334309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 334/666] 10.222.0.32 () {56 vars in 1160 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:14.344212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.358324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:14.360951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 333/667] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:14.367766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f60b4-d593-4fcf-bc3b-abac5403dda6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.369361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.378902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.380759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.381041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.381328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.388267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b6d26-75b7-43cb-bf5f-7fa6e7676eb3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.399941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.400619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.401464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.402153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.402423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.404651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.405113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.405420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.408068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.426334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 335/668] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:14.430223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 334/669] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:14.434908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.442715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.450381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea6c2-ad4b-4cab-aeaa-dc9b96fe1420 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.458685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4905ae-59fd-4375-8e43-1503e5240e4b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.461975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.462966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.463253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.463526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.469586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.470495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.470797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.471068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.471977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=12399215913a4d619dc6be7f0c037347) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.472279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.474307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.481817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 335/670] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/role_assignments?user.id=12399215913a4d619dc6be7f0c037347&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:14.498748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.503091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.559440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:14.562326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 336/671] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:14.571112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.588780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0a695-0a8e-4ee7-90b9-5685fe135559 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.602972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.603713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.603994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.604320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.605076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.605421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.607199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.629599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 336/672] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:14.638602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.667227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5ec32-9f05-48f9-9618-d118a75763ff admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.687944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.689309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.689809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.690300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.707379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.711347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.733141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:14.736390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 337/673] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:14.746331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.771208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1a5d-bd8a-485b-93be-baafd0187435 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.786313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.787472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.787952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.788416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.789908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.790443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.794097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405439b-84d7-4c55-8086-96f6dcb242ac admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.823783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 337/674] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:14.832863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:14.848548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc4557-e07e-4792-85e5-8e20c738e3fe admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:14.856341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:14.857365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.857815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.858227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.859285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=8f0955fb6d7347afb65d3acec567eb1c) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:14.859749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:14.861793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acaccd-2072-4e15-85a8-e256c1ef094b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:14.872848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 338/675] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:14 2022] GET /identity/v3/role_assignments?user.id=8f0955fb6d7347afb65d3acec567eb1c&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:14.943601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510954-bec4-497e-9b20-dab8175e521d None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.944058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510954-bec4-497e-9b20-dab8175e521d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.944502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510954-bec4-497e-9b20-dab8175e521d None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.948531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 338/676] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:14.957373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:14.957923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:14.958342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:14.997267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:14.999668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:15.028028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 339/677] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:15.066474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7510954-bec4-497e-9b20-dab8175e521d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:15.090556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7510954-bec4-497e-9b20-dab8175e521d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:15.098549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:15.100153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.100642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.101121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:15.102458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:15.104531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:15.104531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:15.104531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:15.106277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:15.136264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 03:25:15.139186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 339/678] 10.222.0.32 () {56 vars in 1150 bytes} [Thu Feb 10 03:25:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:15.149442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:15.166607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf433a92-be93-4586-9498-25e1037c47d2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:15.174584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:15.175794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.176284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.176792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:15.178136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:15.178778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:15.180733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:15.180733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:15.180733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:15.182615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642cc2-7f7e-4bee-901b-b16841100b48 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:15.192077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 340/679] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:15.201756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:15.221332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1b25-0685-43c5-afe1-fea8e458c910 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:15.229347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:15.230545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.231072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.231526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:15.233022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:15.233625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:15.235627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:15.235627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:15.235627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:15.237376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97fe18-abca-43f3-ae16-9adb5c97a65e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:15.249242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 340/680] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:15.891212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63f0c-3114-4ee6-8d65-98c878785712 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.891616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63f0c-3114-4ee6-8d65-98c878785712 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.891830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63f0c-3114-4ee6-8d65-98c878785712 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:15.894074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 341/681] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:15.900300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.900623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.900845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:15.924259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:15.925545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:15.939499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 341/682] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:15.971061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63f0c-3114-4ee6-8d65-98c878785712 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:15.987604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63f0c-3114-4ee6-8d65-98c878785712 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:15.993148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:15.993997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:15.994255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:15.994535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.017062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:16.024404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:16.026081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 342/683] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:16.035026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.044771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc785cdd-da3f-45e3-acbc-4b714b3d35ca None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.055115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.055820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.056078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.056358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.057174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.057479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.059187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.075276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 342/684] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:16.084605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.095168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a9c1-5630-49d4-95f2-eb37f184e2de admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.100035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.100902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.101187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.101540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.114923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.116860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.136358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:16.138033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 343/685] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:16.146393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.156618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7ea66-fbdf-426b-8d4b-c60ef503c8cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.161173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.161852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.162133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.162411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.163197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.163500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.165189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.181157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 343/686] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:16.189975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.200446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6245-72cc-4757-bdca-347936a693c7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.209617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.210506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.210862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.211143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.220710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.222892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.242054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:16.243778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 344/687] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:16.253369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.279630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5fc0-fca0-403b-84d7-ca7fba38aae4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.297343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.298503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.299019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.299485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.301097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.301623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.305319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.329320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 344/688] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:16.338248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.348931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e91e8-5122-4201-8ca3-2c121ec9ff08 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.354266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.354961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.355222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.355494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.370557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.372613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.388843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 345/689] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:25:16.397798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.410903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258f7a-3449-4990-8e7b-fbd1ea298049 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.418017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.418924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.419194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.419540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.434867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.436778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.460089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:16.467379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 345/690] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:16.476301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.492441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9757-b1e7-4795-8f5a-98d1e0b05fc3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.497184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.498017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.498301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.498566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.499367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.499670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.501345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.525112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 346/691] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:16.534613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.548109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e768a-0d13-4d70-964a-b4c03becb73d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.559678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.560679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.560943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.561221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.573047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.575240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.594548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:16.596108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 346/692] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:16.605017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.620373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82f1f-914d-4061-a2da-82610ae898b2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.625095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.625776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.626055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.626329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.627531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.627834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.629731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b334-ef77-4e8f-808e-0c3a77a47df5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.657530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 347/693] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:16.667133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:16.690194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e73ae-3c29-4555-96a9-b022f94c0f8c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:16.692977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:16.692977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:16.693528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:16.693528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:16.698698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:16.698698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:16.698698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db003ec-de51-4c0c-80a3-e816e27fd354 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:16.706795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 347/694] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:16 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:17.389797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fc2-87ac-4a48-a9e2-c562fe4999ca None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.391398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fc2-87ac-4a48-a9e2-c562fe4999ca None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.392235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fc2-87ac-4a48-a9e2-c562fe4999ca None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.396212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 348/695] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:17.408536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.409977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.410765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.447170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:17.449760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:17.470686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 348/696] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:17.565516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903fc2-87ac-4a48-a9e2-c562fe4999ca None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:17.589703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903fc2-87ac-4a48-a9e2-c562fe4999ca None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:17.606253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:17.611810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.612637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.613463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.646755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:17.679357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:17.695478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 349/697] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:17.707583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:17.729591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e067a-1698-426e-a4e0-fc41cdbab507 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:17.741030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:17.742676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.743430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.744178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.745879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:17.746758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:17.750297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:17.776187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 349/698] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:17.785631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:17.810428 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23bbf8-2f96-466c-a2b7-f858f0b81a50 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:17.822137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:17.824052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.824892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.825756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.857685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:17.861847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:17.905605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:17.908358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 350/699] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:17.919241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:17.944161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ca75-c2ea-47bc-b3e8-b8520b46681b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:17.963017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:17.963720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:17.964002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:17.964278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:17.965093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:17.965398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:17.967183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:17.988637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 350/700] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:17.999335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.020534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bce073-48b5-452e-90a7-92b13618ba1c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.025797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.026693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.027311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.027587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.044711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.047162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.075514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2fa6d36a-36a8-4587-b4cf-d3916d1122bc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:18.077334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 351/701] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:18.087569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.112711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15757-ee2e-477b-ab22-88e5be410eec admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.126008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.127581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.128063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.128538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.130169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:18.130696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.134193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.154966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3ff7-2d8f-4ae5-8d55-7eaf2f99d125 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.155594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3ff7-2d8f-4ae5-8d55-7eaf2f99d125 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.156161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb3ff7-2d8f-4ae5-8d55-7eaf2f99d125 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.160139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 352/702] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:18.161619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 351/703] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:18.169146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.169685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.170191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.177361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.188508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f981c5-bc29-4654-8fd8-61df34270368 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.193405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.194075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.194329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.194583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.203884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.205678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.216500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 352/704] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:25:18.230277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.230760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:18.232915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:18.240092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1fce-0d7c-48fd-9265-bca1b0aced73 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.247824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.248647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.248938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.249171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.255761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 353/705] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:18.265410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.267334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.287008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:18.288614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 353/706] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:18.297095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.312776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22cfa5-ed27-43d8-a561-9e88294827de None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.318038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.318754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.319107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.319519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.320277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:18.320625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.320896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.327466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.351505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ac0-14d1-4061-bcbf-36cf055aee61 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.365248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 354/707] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:18.367730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.369083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.369630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.370112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.374324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.391425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d04a5-6a23-4cea-8653-d3d735301ca0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.399062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.400464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.400971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.401480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.403514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.405478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.422619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.428748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.475635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:18.478501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 354/708] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:18.480253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:18.487436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 355/709] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:18.497558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.513196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.532080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf4d2-3c5b-41ad-92e9-228ca72f0e48 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.545620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc8fa-d1bd-40a8-9bae-55166f932907 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.562613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.565813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.567354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.567880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.568297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.568896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.569434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.570690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.572173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:18.572879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:18.573441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.574768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.581795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.583714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.623510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 355/710] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:18.632241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 356/711] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:18.643433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.655868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:18.663405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d8c13-a058-444e-8888-caf6cfa759fe admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.678249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcfd95-a781-42fa-93a7-fdb213df81aa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:18.689951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.689951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.689951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.689951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.693636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.693636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f744c-3370-4a76-ab5d-7ae9445e4582 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.697622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:18.698601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:18.699103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:18.699526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:18.702852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b2e93de4f4c34d25bbb086fc94bca1d8) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:18.703399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:18.708376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24774-09a1-4576-bef4-224616b445b1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:18.723836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 357/712] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:18 2022] GET /identity/v3/role_assignments?user.id=b2e93de4f4c34d25bbb086fc94bca1d8&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:18.742913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 356/713] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:25:18 2022] POST /identity/v3/users => generated 254 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:19.234875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f624-826e-4657-8217-c33c8f010126 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.235395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f624-826e-4657-8217-c33c8f010126 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.235772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f624-826e-4657-8217-c33c8f010126 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.239304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 358/714] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:19.248494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.249421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.250176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.292801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:19.295810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:19.312237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 357/715] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 10 03:25:19.338766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f624-826e-4657-8217-c33c8f010126 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:19.371954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f624-826e-4657-8217-c33c8f010126 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:19.387646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:19.389115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.389620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.390108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.391429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:19.393463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:19.393463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:19.393463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:19.395199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:19.421414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 03:25:19.424180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 359/716] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:19 2022] GET /identity/v3/services/network => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:19.430523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:19.459133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213399-f4e3-420e-9498-e1b291b814b5 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:19.477357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:19.479847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.480653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.481478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.483243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:19.484086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:19.487610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb73a2-f62d-4220-9605-1474611f00d6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:19.501924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 358/717] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:19.508537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:19.537373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834991e2-1bc5-45a1-9abe-3a96d26fcfe5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:19.551451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:19.552554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.553047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.553482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.554842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:19.555338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:19.558286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23744723-3ab3-48aa-b62c-2196cb0b128b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:19.575665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 360/718] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:19.894623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbc9af-d2fc-4ab4-b8c7-c86350a695d2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.895635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbc9af-d2fc-4ab4-b8c7-c86350a695d2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.896409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbc9af-d2fc-4ab4-b8c7-c86350a695d2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.900050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 359/719] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:19.909490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210592d-8b1a-4ea0-8082-a4f9fc94a9c5 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:19.910000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210592d-8b1a-4ea0-8082-a4f9fc94a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:19.910517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210592d-8b1a-4ea0-8082-a4f9fc94a9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:19.947592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7210592d-8b1a-4ea0-8082-a4f9fc94a9c5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:19.949719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7210592d-8b1a-4ea0-8082-a4f9fc94a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:19.964823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 361/720] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 10 03:25:20.020003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbc9af-d2fc-4ab4-b8c7-c86350a695d2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:20.051117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbc9af-d2fc-4ab4-b8c7-c86350a695d2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:20.063765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:20.065346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.066113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.066924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:20.068590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:20.070760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:20.070760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:20.070760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:20.073076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8b7e7-2560-4469-8187-a5be629934ec admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:20.119503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 360/721] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:20 2022] POST /identity/v3/services => generated 251 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:20.607946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46a58-b0cb-4de8-916e-aadce839f8fe None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.608724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46a58-b0cb-4de8-916e-aadce839f8fe None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.608724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46a58-b0cb-4de8-916e-aadce839f8fe None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:20.610563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 362/722] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:20.618785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.620278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.621076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:20.658224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:20.678468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:20.729337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 361/723] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:20 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:20.791524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46a58-b0cb-4de8-916e-aadce839f8fe None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:20.817193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46a58-b0cb-4de8-916e-aadce839f8fe None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:20.827734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:20.828996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.829457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.829905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:20.852583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:20.869510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:20.872795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 363/724] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:20.880383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:20.898681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b97a2-c044-4f30-be39-ded2daf0d63f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:20.909409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:20.910520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.911027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.911504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:20.912918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:20.913449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:20.916514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:20.937764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 362/725] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:20.945039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:20.966896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5c900-2665-4545-8af9-31f49edc1735 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:20.977826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:20.979450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:20.979941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:20.980435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.012825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.016493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.054697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:21.057259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 364/726] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:21.065698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.085306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70728505-16de-436d-a569-0f43aa321ee4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.097115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.098202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.098700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.099179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.100509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:21.101039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.104020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.138228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 363/727] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:21.144097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.161673 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940284-fe67-4f31-9c9d-67ab317d2335 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.177162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.178495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.179029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.179521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.195273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.199159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.233327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:21.236078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 365/728] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:21.241911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.268151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb439-6f4f-4162-9583-8d4054513942 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.281390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.282619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.283112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.283568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.285027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:21.285535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.288898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.329418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 364/729] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:21.335343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.364433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7813c3-5736-40db-80e8-40aff3403e94 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.379965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.381313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.381807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.382292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.411631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.415025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.451576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:21.454747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 366/730] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:21.461417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.488856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed29cf-e37c-45ee-b83e-81eff4e740e1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.503784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.505103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.505627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.506126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.507713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:21.508264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.511719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.545017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 365/731] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:21.553916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.579714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409979b-4c5a-4238-a8b8-572cce1252af admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.596688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.598530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.599378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.600124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.622895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.628506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.665619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:21.675046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 367/732] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:21.685175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.718965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbebec-7d5e-415f-9135-e05f6259ff75 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.733204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.734388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.734904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.735431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.736927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:21.737471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.741334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2e1e-10f4-4f51-8b60-8c38543e38bd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.777771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 366/733] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:21.787680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:21.814917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce297e90-f85c-44b8-b5e2-9ff6dc38495f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:21.826731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:21.828325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:21.828821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:21.829313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:21.837139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=74c6cf5d4bba4126a0a94a4db29dee52, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:21.842554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056082-5266-4ec4-81ff-3cfeedb34e99 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:21.874983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 368/734] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:21 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:23.154915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030eb5-539b-4ad7-bb16-d1c5695c624d None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.156514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030eb5-539b-4ad7-bb16-d1c5695c624d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.157344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030eb5-539b-4ad7-bb16-d1c5695c624d None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.163523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 367/735] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:23.171736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.173301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.174092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.207652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:23.210355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:23.334831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 369/736] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:23 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:23.371934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8030eb5-539b-4ad7-bb16-d1c5695c624d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.396299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8030eb5-539b-4ad7-bb16-d1c5695c624d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.405411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.407449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.408327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.409106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.435578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:23.449849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:23.456730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 368/737] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:23.463560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.481203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec566ba-239b-4cd6-8a70-7b104dec561d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.489707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.491488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.492335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.493141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.494928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:23.495828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.499536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.522819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 370/738] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:23.527640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.545340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f5ff-9055-45f6-9288-636cdecb2ed6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.553682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.555630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.556402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.557287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.587281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.591430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.623877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-203bad74-46e2-4381-a1cf-615adeddfdf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:23.633760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 369/739] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:23.636391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.648366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a512-f4d1-4848-ba4b-84552f4f54b7 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.652258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a512-f4d1-4848-ba4b-84552f4f54b7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.653069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a512-f4d1-4848-ba4b-84552f4f54b7 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.663453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde231-808b-483d-9aae-5fcd206022d4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.664761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 370/740] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:23 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:23.673576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.674514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.679604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.694270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.695885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.699542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.700456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.702216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:23.706182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.709737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.735337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:23.738368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:23.741383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 371/741] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:23.749658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.757746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 371/742] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:23 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:23.764449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9670b-f9cd-4e89-9ebc-2ef4c6dd0652 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.769141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.769963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.770234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.770696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.779370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.781598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.797495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:23.799292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 372/743] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:23.808453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.814075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.824939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7c552-5d15-422e-8411-061d9ab97f2a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.831210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7f378-33ed-4063-89be-97d3ed4e1ca4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.834336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.835451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.836351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.837188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.846622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.847606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.848021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.848426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.849449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:23.851328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.853387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.862034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:23.873243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:23.875032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 373/744] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:23.881301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.891486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44fb-c1a3-4bc8-908c-da9f9b5c2e11 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.900000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 372/745] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:23.902643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.903832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.904284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.904869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.906299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.916270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:23.916714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.919345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.930713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c91e-cd1a-4dc3-8642-3cdbe13180cd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.938738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.942772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.942772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.942772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.943293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 374/746] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:23.947770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:23.960723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:23.962879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:23.965253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ab09c-2ad4-47c0-b4c1-04737d9d8b93 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:23.984239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:23.985451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:23.985936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:23.986419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:23.987455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 373/747] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:25:23.992186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.007628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e63518-cf45-4a49-8550-2c3128b224ff admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.012028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.013207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.014249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.014747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.015214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.015944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.027854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.030151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.050036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d2c86049-7a38-4c36-acc0-afe3d4f3faa3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:24.051945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 374/748] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:24.053460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0657bf-b28d-4cbd-9fac-04a5654e47aa None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.053985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0657bf-b28d-4cbd-9fac-04a5654e47aa None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.054459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0657bf-b28d-4cbd-9fac-04a5654e47aa None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.054914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-19c9289c-a089-4bf1-98e1-590d8f2c51ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:24.056839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 375/749] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:24.061831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0657bf-b28d-4cbd-9fac-04a5654e47aa None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.064094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 375/750] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.068792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.068792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.068792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.079956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0657bf-b28d-4cbd-9fac-04a5654e47aa None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.085428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.086304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.086743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.087144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.088009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.088460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.090797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.099734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:24.101919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:24.104172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 376/751] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.105288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.115908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefcca1-70db-496e-adcc-3c8fcf13e25f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.120800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.121760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.122366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.122903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 376/752] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:24 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:24.123220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.124184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.124585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.124899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.127122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25706dbe-2224-451e-a951-6e9587bf86e7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.141135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 377/753] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.147382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488849b-1ef3-4d49-a2b8-b1c6ec3a9dff None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.147782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488849b-1ef3-4d49-a2b8-b1c6ec3a9dff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.147927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488849b-1ef3-4d49-a2b8-b1c6ec3a9dff None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.149916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 378/754] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:24.152400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488849b-1ef3-4d49-a2b8-b1c6ec3a9dff None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.154495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccd6e4-a118-47de-b148-4834c02249d4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.164701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.164998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488849b-1ef3-4d49-a2b8-b1c6ec3a9dff None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.166019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.166588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.167023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.169876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.170824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.171111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.171458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.179782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.180220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.181926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.183947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.197648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-fced8dca-0f1c-4216-84f1-a025ed89f103 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:24.199144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 379/755] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.202352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.202352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.202352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.203179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:24.203549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 377/756] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.204948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.220155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:24.221320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955e08-3526-4c96-813a-8f478c5d8688 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.221511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:24.226607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.227569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.228008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.228446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.229350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.235887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 380/757] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:24 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:24.235887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.236157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:24.236157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:24.236157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:24.236157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.255260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505d0c-58fa-4743-80f6-132f65307285 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.257016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 378/758] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:24 2022] POST /identity/v3/services => generated 240 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:24.258730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.285489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.286697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.287174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.287691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.288864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.289410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.291731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.317685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 381/759] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.319299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.326221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472d7d4-fdd7-491d-b09c-211b56c99c2f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.338996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.340112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.340677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.341211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.341879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06222b-9d32-4e99-b656-fc0e5b1162f2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.342579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.343175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.345379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.351433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.353011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.353561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.354035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.356530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.360307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.364416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 379/760] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.365697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.377626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bc6f-ff34-458b-abf0-1df8aa9fcc90 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.383218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.384381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.384874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.385410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.387721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 03:25:24.395338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 382/761] 10.222.0.32 () {56 vars in 1150 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.395338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.401831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.404363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.411808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced817-f66f-42fb-a209-0c9aee29fe0a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.417768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 380/762] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:25:24.419706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.432416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.434294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.434587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.434962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.435795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b2e93de4f4c34d25bbb086fc94bca1d8) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.436386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.438319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.444075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078355c9-d706-4e84-8dc3-20258e65c2fe admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.445145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 383/763] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/role_assignments?user.id=b2e93de4f4c34d25bbb086fc94bca1d8&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.446022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.456804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.457347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8025fcd-4553-47c2-83b5-95ad02bb0e54 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.459251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.460312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.461163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.463157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.463341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.463934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.464248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.464584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.464993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.469322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.478178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.480436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.481698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 381/764] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.488055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.505420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:24.506865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 384/765] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.508691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb6f96-073d-4028-9a69-f6aac2bf04a6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.522022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.529254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.529564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.529889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.530173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.531140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.531490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.533172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.539259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6ae7-b2f9-4bb1-b8a6-465f09c2ad05 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.540948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 382/766] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.546171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.554791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.556551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.556723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa33b-0e0d-4c17-a3f1-613493cbe8a1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.557600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.558475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.560298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.561295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.562135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.562920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.563295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.563619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.564722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] RBAC: Adding query filter params (interface=public, service_id=057d9a6d789b47ffaa8b8154c65f0204, region_id=RegionOne) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.565100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.566195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:24.566195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:24.566195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:24.566765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.567404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.582210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 383/767] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/endpoints?service_id=057d9a6d789b47ffaa8b8154c65f0204&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.584536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.595134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 385/768] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:24.600340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58c96-bcf5-45b5-a20a-34b6abc74e24 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.602395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.612857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.614525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.615384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.616185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.617175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9570088-7d97-4ec9-a2e2-36618d403ec4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.618148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.622069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.623427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.624311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.624595 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.624869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.636102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 384/769] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/services => generated 772 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.646496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.651347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.689941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:24.693193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 386/770] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:24.699718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.726079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c9ca-c0cd-46ce-9936-421c40024c91 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.740051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.741552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.742256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.742981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.744773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.745582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.749801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881e11b-c4b9-4700-aadc-a8993028905a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.774795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 385/771] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:24.783005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:24.803952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a339-9afa-452f-8d27-b84d5bc97832 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:24.812012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:24.813578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:24.814282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:24.814927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:24.816798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=862a7e9af971415ab1e8c9cb325994f5) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:24.817514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:24.821334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92354d6f-cbac-4ff6-878b-df1e5f1e9492 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:24.832293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 387/772] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:24 2022] GET /identity/v3/role_assignments?user.id=862a7e9af971415ab1e8c9cb325994f5&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:25.763692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768cb61-98b3-423f-9427-54e7028f996b None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:25.764481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768cb61-98b3-423f-9427-54e7028f996b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:25.764481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768cb61-98b3-423f-9427-54e7028f996b None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:25.766518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 386/773] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:25.773322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:25.774204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:25.774204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:25.799800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:25.801058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:25.814604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 388/774] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:25.846624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768cb61-98b3-423f-9427-54e7028f996b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:25.877388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768cb61-98b3-423f-9427-54e7028f996b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:25.882195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:25.883071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:25.883348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:25.883616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:25.897412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:25.904783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:25.906455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 387/775] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:25.912744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:25.936062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6007-51a8-4e93-8a24-314e3ef5d03f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:25.949551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:25.951439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:25.952221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:25.952933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:25.954705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:25.955542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:25.959012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:25.985438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 389/776] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:25.990937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.005470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b8f9-7e89-4dba-be31-ad7719cd6758 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.015381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.016230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.016505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.016768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.033900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.036049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.066058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:26.067704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 388/777] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:26.074059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.103378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03b98-8057-4d3b-9e73-535dd3496899 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.121440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.123242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.124047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.124797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.126861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:26.127709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.131025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.158300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 390/778] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:26.163711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.185209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09d356-0676-4823-a275-ba35db2263d5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.200343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.201080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.201365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.201681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.215109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.217313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.232954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:26.234611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 389/779] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:26.240230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.251990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ca9e-6611-4ab3-92f4-72fdaf76f48a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.265173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.265894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.266253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.266523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.267589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:26.267905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.270016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.299433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 391/780] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:26.305467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.320510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffc9a3-abca-4bb0-80fa-d86f7ee4afc1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.330484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.331300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.331583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.331974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.342734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.344737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.361772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 390/781] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:25:26.370618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.399071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088475f-27df-4941-8542-1f4a93e1eb4e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.415230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.417132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.417957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.418764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.444917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.449179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.495163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:26.498489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 392/782] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:26.507242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.518971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f6f60-7a60-493c-bc46-8ae0393c7b81 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.532965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.533705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.534101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.534380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.535168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:26.535475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.537122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.550562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 391/783] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:26.559439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.584371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0514e8-d850-49c1-b98b-3b2e582f9b47 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.600732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.602565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.603420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.604159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.624644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.629194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.666714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:26.669797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 393/784] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:26.678792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.707364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94596105-eca3-45d0-8a11-d9615b817284 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.724512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.725206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.725534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.725815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.726631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:26.726970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.728873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65d51a-2521-43d7-9baf-d1e38056ea12 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.752406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 392/785] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:26.761778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:26.795096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fbc0c-1502-4903-b56c-a8e0f1b75267 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:26.809296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:26.810428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:26.810943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:26.811435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:26.813062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:26.813625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:26.817347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd17b7d-1f47-4fe2-9dac-2a37fe3fe0db admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:26.834640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 394/786] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:26 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:27.738073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da647b-5b7e-4fa8-be91-0948f52fd2ea None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.738871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da647b-5b7e-4fa8-be91-0948f52fd2ea None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.739388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da647b-5b7e-4fa8-be91-0948f52fd2ea None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.743422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 393/787] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:27.765822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687bf9f-12fa-4c03-ad28-67c4ef35cbc1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.766149 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687bf9f-12fa-4c03-ad28-67c4ef35cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.766356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687bf9f-12fa-4c03-ad28-67c4ef35cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.792640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8687bf9f-12fa-4c03-ad28-67c4ef35cbc1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:27.793877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8687bf9f-12fa-4c03-ad28-67c4ef35cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:27.806629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 395/788] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:27.868232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da647b-5b7e-4fa8-be91-0948f52fd2ea None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:27.877453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c0a8-1520-4096-b385-493d5ddd44e2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.877798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c0a8-1520-4096-b385-493d5ddd44e2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.877991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c0a8-1520-4096-b385-493d5ddd44e2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.880220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 396/789] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:27.887342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.887646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.887938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.899796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da647b-5b7e-4fa8-be91-0948f52fd2ea None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:27.907557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:27.908799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:27.911847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:27.913296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.913779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.914279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] PATH_INFO: `/v3/services/network` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.915595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:27.918854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:27.923025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 397/790] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:27.942993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:27.950893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 03:25:27.953512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 394/791] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:27 2022] GET /identity/v3/services/network => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:27.954428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4424be-08f9-41e9-8b94-d6d44fdb2dbb None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:27.959758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:27.961423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:27.963574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.964049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.964547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.966038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:27.969146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:27.972446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e7b45-75d6-43f2-b0fd-86912dd8392c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:27.977432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:27.978155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.978437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.978811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.979561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] RBAC: Adding query filter params (name=network) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:27.979868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:27.981633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eabf8-82e9-4070-a914-baef238ac5da admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:27.987139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 395/792] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:27.988404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d275c2-a0cf-4d51-8b8a-79ec349c65f3 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.988660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d275c2-a0cf-4d51-8b8a-79ec349c65f3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.988942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d275c2-a0cf-4d51-8b8a-79ec349c65f3 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.990888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 396/793] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:27.992042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b296b3-9f8d-431c-be85-f006375b1a05 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:27.992323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b296b3-9f8d-431c-be85-f006375b1a05 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:27.992599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b296b3-9f8d-431c-be85-f006375b1a05 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:27.993445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f7b9a593-374e-4cd8-be17-5672140ac199 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 10 03:25:27.994500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 397/794] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:27.995335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b296b3-9f8d-431c-be85-f006375b1a05 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:27.995755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 398/795] 10.222.0.32 () {56 vars in 1150 bytes} [Thu Feb 10 03:25:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.006951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.007457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.007947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.009303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b296b3-9f8d-431c-be85-f006375b1a05 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.013759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.014437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.014752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.015029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.015767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.016076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.017717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.023225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 398/796] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.024067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.034010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f777a61-e837-4cef-95fb-b938b1d4f7e9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.037526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:28.038423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.039131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.039412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.039630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:28.039735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.040405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.040712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.042338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d93e3-fff7-4266-b2b0-375ed2af3232 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.047572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 399/797] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.049232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.049523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.049801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.056756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 399/798] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:28 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:28.058543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.070334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:28.071871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:28.075137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531df41-b419-49b3-8ba2-c47db3a81d8f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.080292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 400/799] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:28 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:28.081429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.082929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.084095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.084555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.085076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.086560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] RBAC: Adding query filter params (interface=public, service_id=27b89778597e4c1e89365d85a200ed37, region_id=RegionOne) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.087178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.089061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:28.089061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:28.089061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:28.090841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.093084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c212c-beaa-4c13-93f5-6d4d9403cd21 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.097938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.098954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.099454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.099923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.100865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.101380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.103288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.105739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 400/800] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/endpoints?service_id=27b89778597e4c1e89365d85a200ed37&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.107400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.112002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 401/801] 10.222.0.32 () {56 vars in 1145 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.113046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.122867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae56a4-316c-4d8d-91d9-6200801008ab admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.124242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07c175-c2d1-414d-adf6-cdbcfd0cdf60 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.128118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.128919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.129197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.129470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.132011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.133283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.133740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.134206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.140543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:28.147659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:28.148901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 402/802] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.149683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.155332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:28.159681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba2fe5-4f4c-4a1c-88bb-28f8d9492d6a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.165153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.165807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.166093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.166371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.167112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.168739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.169088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:28.171412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 401/803] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.176588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.176831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 403/804] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.176831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.190705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4803d-b9da-4aa1-ba60-445002eb52a8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.195688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.196688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.197198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.197672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.197799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cab9f-8e39-43e1-9212-d1acdc486d23 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.198826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.199313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.201439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.203038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.204090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.204461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.205260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.206159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.207346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:28.207346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:25:28.207346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:25:28.208596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.213343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 404/805] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.214506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.229001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f1709-9fba-4723-bbd2-df493ff67c16 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.238448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.239192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.239476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.239749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.240529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.240835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.242459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.247854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 402/806] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:28.249820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.257568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 405/807] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.259191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.271155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6968f7-e9d1-40f1-a506-a2217fa9ce1c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.279679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2a67e-0875-446e-9027-f825b7d66a6c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.289654 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.290478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.290787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.291061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.293322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.294251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.294530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.294845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.309412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.311424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.315320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.317644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.331170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:28.332797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 406/808] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.340973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.346436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:28.353607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 403/809] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.354881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.363950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc53-e84c-4b6b-9483-ac3e2333ad44 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.367584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19e67-a5f4-434a-b9d0-1001010eb2f5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.373127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.374427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.374945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.375442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.376671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.377127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.377570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.377679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.378040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.378406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.379984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.383713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.384236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.386198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.398107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 404/810] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.404446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.410782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 407/811] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.421831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d46a1-3f55-4401-933f-cbc386bd7ddd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.424092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.427377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.428769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.429187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.429676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.438952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.442253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.444878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0c8c9-cccf-44bb-84f2-4f8fdbfe7d81 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.460130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:28.461057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.462090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.462266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 405/812] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:28.466191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.466191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.469147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.479523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.481848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.488161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436a69-a6d6-4b55-b495-fc7d4483acc0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.496466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.497711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.498218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.498495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:28.498738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.500044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 408/813] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:28.500888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.501803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.506129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.507057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.518330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c723538-5b22-43c5-9f17-a23f512474f4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.525374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.526506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.527101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.527579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.528817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.529581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.532021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.546731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 406/814] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:28.551061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.566110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ff18-fcf4-489b-a7b1-f8b439234042 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.571139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 409/815] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:28.573620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.574859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.575450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.575909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.577624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.590408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c6b4-9b72-452e-a1d4-fe81d41547be admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.592913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.595180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.596090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.596904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.597181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.597453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.611653 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.613861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.617358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:28.622720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 407/816] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.636095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.639216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:28.641128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 410/817] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.649756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.657697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed0eb-cb65-41c4-a816-58256e752ebc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.661574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2584d-da10-4bb1-ad8d-22088f2b20ea admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.670040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.670040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.670700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.673538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.673538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.674322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.677810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.678026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.678884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.679312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.679748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.680659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.681121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.688388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.703018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 411/819] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:28.707019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 408/819] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.709073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.712504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.720906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0929db-5afd-49fd-84fa-7b54a5afdc99 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.725702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.726737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.727166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.727580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.730913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a7ad-b544-4855-b2ae-30b6cdff04d6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.736665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.739142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.739846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.741413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.742046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.742663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.756404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:28.757865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.758386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 412/820] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:28.762035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.764444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.774918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b8752-4069-4a83-9b6e-379a4022dcb1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.780073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.780993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.781421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.781840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.782836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.783291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.785345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.790287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:28.792033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 409/821] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:28.799658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.800638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 413/822] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:28.806688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.818009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc25d9b-5470-453d-ae7b-f5c114fc1c0d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.820726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35593b97-5363-41d7-8f45-3804e190bc64 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.824945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.826119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.826707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.827202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/862a7e9af971415ab1e8c9cb325994f5/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.833388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:28.834554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:28.835103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:28.835575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:28.837085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:28.837619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.841602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.847837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=862a7e9af971415ab1e8c9cb325994f5, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:28.851120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33defc4-5351-4229-b025-08ec6cbe5930 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:28.862420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 410/823] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:28.866450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 414/824] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:28 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/862a7e9af971415ab1e8c9cb325994f5/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:28.870689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:28.889179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7ff08-d977-4a20-8d27-81ca85287f80 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:28.999420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:29.001084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:29.002015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:29.002496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b2e93de4f4c34d25bbb086fc94bca1d8/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:29.006410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=b2e93de4f4c34d25bbb086fc94bca1d8, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:29.012371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578e98-aa12-44d3-9bd2-acc390c61e1b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:29.051924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 411/825] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:28 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b2e93de4f4c34d25bbb086fc94bca1d8/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:25:30.898764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11dcc-e2e8-4cd8-8b47-fbd1672397d3 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:30.899841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11dcc-e2e8-4cd8-8b47-fbd1672397d3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:30.900324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11dcc-e2e8-4cd8-8b47-fbd1672397d3 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:30.902577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 415/826] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:30.908759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:30.909659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:30.910156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:30.939562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:30.941168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:31.020440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 412/827] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:30 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:31.056628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11dcc-e2e8-4cd8-8b47-fbd1672397d3 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.087771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11dcc-e2e8-4cd8-8b47-fbd1672397d3 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.094642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.096111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.096569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.097046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.098172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.101230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.123745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 03:25:31.126897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 416/828] 10.222.0.32 () {56 vars in 1153 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:31.132931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.153141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c6ce-4cf5-4a05-8dc0-dd89017adc97 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.164572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.165267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.165543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.165810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.166545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:31.166877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.168525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea7a2-1ac2-44a0-b59a-cd27d6e5d94f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.179498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 413/829] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:31.186070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.212083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2c928-d708-4c29-a318-55a0bc7435f8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.225380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.226541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.227142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.227632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.228959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:31.229480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.232687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1e64f-0431-448b-9456-f3ddb651711b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.241853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 417/830] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:31.495657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668eb5d-9429-4911-81d2-5fd896edc1c6 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.496344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668eb5d-9429-4911-81d2-5fd896edc1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.496833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668eb5d-9429-4911-81d2-5fd896edc1c6 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.499286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 414/831] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:31.515410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.515728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.515959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.536509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:31.537849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:31.553228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 418/832] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:31 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:31.589729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668eb5d-9429-4911-81d2-5fd896edc1c6 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.606072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668eb5d-9429-4911-81d2-5fd896edc1c6 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.611464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.612755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.613252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.613737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.614763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.616683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.629933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 10 03:25:31.632006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 415/833] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:31.638810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.649184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb9eac-cf0b-4917-b723-fb437a545d77 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.654594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.655695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.656208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.656684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.657651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] RBAC: Adding query filter params (name=network) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:31.658190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.660103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.666124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 419/834] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:31.678330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.695091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353528e-a86c-42b7-981e-22ee7a5cf2b9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.703212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.704303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.704796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.705310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.706277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:31.706834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.708729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd08f17-5387-4e85-a901-f6f89d1796a7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.715095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 416/835] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:31.721294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:31.733158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d14c-4661-45ff-a60b-f6d87bdb87cc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:31.738456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:31.739461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:31.739914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:31.740424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:31.741350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:31.742602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:25:31.742602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:25:31.742602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:25:31.743945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867d987-af18-45a6-b1f4-a6244794781c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:31.769453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 420/836] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:32.213020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ed19-9d00-4141-8dc6-782e48365d13 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.213562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ed19-9d00-4141-8dc6-782e48365d13 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.213852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ed19-9d00-4141-8dc6-782e48365d13 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.217704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 417/837] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:32.231837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.232351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.232817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.270317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:32.272501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:32.305568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cec2f-56cd-4fbe-b4d9-b40cfb85d6f2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.305986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cec2f-56cd-4fbe-b4d9-b40cfb85d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.306392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cec2f-56cd-4fbe-b4d9-b40cfb85d6f2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.310138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 418/839] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:32.310282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 421/839] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:32 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:32.327602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.328060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.328495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.356851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.365098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:32.367024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:32.378498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8b5ea-298b-4ca6-adc3-2a28ae405ec2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.384082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 419/840] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:32 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:32.393732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.395197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.395709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.396204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.417710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:32.432146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:25:32.433364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.434894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 422/841] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:32.448651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.453999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33228471-9389-4c76-93ce-c56f376e37fe None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.462193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.463674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.464095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.464562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.465837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.468095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d48ef-7d07-4973-ad60-1eac2a4e9968 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.468885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.476527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.477741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.478238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.478763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.480216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:32.480778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.483984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.486996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 03:25:32.488843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 420/842] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:32.499672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.501557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 423/843] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:32.510587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.519066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4914e-50ec-477b-a03b-7e85ce9ac27e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.528817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.530494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.531407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.531771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a362c6-0c95-4c1a-a005-276746010f4a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.532408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.534151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:32.535072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.538599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.540495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.542052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.542604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.543142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.554832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 421/844] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:32.562719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.565682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.569718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.581752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec46b3-276b-4bf5-9605-19073ed5ba8c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.592333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.593857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.594580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.595288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.596789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:32.597603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.600903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.605753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:32.610187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 422/846] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:32.614834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 424/846] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:32.617973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.637222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344170b8-9875-4954-8c1d-7b7fac629bed admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.645825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.647104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.647652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.648177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.649682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:32.650259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.653722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.679183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 425/847] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:32.688623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.707335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212616-18c9-4ede-ae08-644770a36bb4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.715615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.717157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.717726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.718211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.734408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.738511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.768015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-744fc083-61cb-4bf2-b6ab-ad81bdf58022 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:32.770756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 423/848] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:32.780504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.799138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e489-b490-41a5-885a-ad67825cfb3d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.807426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.808738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.809242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.809779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.811620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:32.812280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.816260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.836938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba301f-7bd8-4651-81d3-e7cf4d4d1ac8 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.837425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba301f-7bd8-4651-81d3-e7cf4d4d1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.837926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba301f-7bd8-4651-81d3-e7cf4d4d1ac8 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.841973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 424/849] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:32.848592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.849290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.849910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.855864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 426/850] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:32.865645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.883373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:32.884571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fa11-44b9-481d-8b55-afacd4bd965a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.885917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:32.895635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.896676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.897158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.897651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.899463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 425/851] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:32 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:32.913857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:32.917548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:32.933792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.936222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 427/852] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:25:32.947787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:32.950614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db13d8-2793-4024-a464-5391c3e7c85a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.959134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.960708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.961110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.961603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.967478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0af49a-7b7b-464e-ba5b-ca04944fbc14 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:32.975831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:32.978127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:32.978918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:32.979641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:32.983996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:32.998232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:33.000334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.001080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 426/853] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:33.004763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.007365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.025351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:33.032517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 428/854] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:33.032776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fc17c-0395-4f45-abde-4b829a50bc47 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.035859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.040764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.043430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.044248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.045205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.046680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.047233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1e44-f232-422b-a117-981014aa8b09 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.047577 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.051451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.052982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.053809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.054189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.054579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.055548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.055964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.057762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.071513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 429/855] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:33.072398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 427/856] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:33.080436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.090060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.093097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbbb0-6a9a-4a27-a8f3-c8ac390f3ecb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.098058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.099018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.099407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.099740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.112358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.113639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a221fd-e428-4770-90ec-800207082888 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.114401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.123561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.126598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.127380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.128040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.134049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:33.135737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 430/857] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:33.141565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.142113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.146199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.152739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608476-d1bb-4628-8ce7-6e413d5b712f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.158104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.158971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.159318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.159659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.160568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.160939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.162944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.183535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 431/858] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:33.187667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:33.189389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.191031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 428/859] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:33.201007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.204273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56697510-99a8-4b81-b621-3f323dd6d023 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.209545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.210571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.211009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.211352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.220768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.221914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ba28-7f17-43b2-a9b8-c99d836bc822 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.223041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.230610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.232168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.232845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.233502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.235190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.236092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.239756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 10 03:25:33.240483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.241439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 432/860] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:33.247361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.259076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b1616-7ace-47e3-9a5a-8054986976c3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.264091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.264925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.265267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.265604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.266592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.267003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.274695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.275136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 429/861] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:33.278783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.295605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 433/862] 10.222.0.32 () {56 vars in 1156 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:33.296379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517d95-66e0-4a59-b45a-3419fb14c09d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.296914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.304345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.305973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.306612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.307248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.308026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c263b4-78ac-4a9e-acea-405fd735dec4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.309096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=862a7e9af971415ab1e8c9cb325994f5) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.310225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.313285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.314119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.314468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.314844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.315924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.324536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.326635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.329554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 430/863] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/role_assignments?user.id=862a7e9af971415ab1e8c9cb325994f5&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:33.341102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 434/864] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:25:33.347800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.366568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac30cf-62e6-4908-bc20-10fba17802e4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.375032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.377154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.377860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.378527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.400731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.404897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.439010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:33.441941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 431/865] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:33.447587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.457800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5099f7-1bf6-4207-9ed6-10ba7a75fd71 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.463197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.464026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.464415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.464811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.465703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.466113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.468009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.481768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 435/866] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:33.488529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.501117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105f2-9a67-440e-a147-6061865a439a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.506619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.507807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.508304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.508822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.517634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.520077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.536048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:33.538003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 432/867] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:33.544393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.556707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d10e-78cf-4cd9-b0d8-e86f27755b8b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.562165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.563280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.563768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.564313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.565410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.565924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.568072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb3412-029f-4262-96ff-c3aa3e4b8a61 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.582516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 436/868] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:33.592704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:33.609967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc734282-c52a-4f5e-84eb-8f4049056f4b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:33.616280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:33.617202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.617587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.617953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.619243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b2e93de4f4c34d25bbb086fc94bca1d8) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:33.619811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:33.622681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76263-ed31-4e04-bb5d-f7c09afab5f8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:33.634497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 433/869] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:33 2022] GET /identity/v3/role_assignments?user.id=b2e93de4f4c34d25bbb086fc94bca1d8&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:33.972982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d464-8f23-4700-8fb9-35114ed62d9d None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.973371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d464-8f23-4700-8fb9-35114ed62d9d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.973557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d464-8f23-4700-8fb9-35114ed62d9d None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:33.975656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 437/870] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:33.981618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ee02e-43ee-40aa-bab7-441bd695c59a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:33.981905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ee02e-43ee-40aa-bab7-441bd695c59a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:33.982171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ee02e-43ee-40aa-bab7-441bd695c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:34.002085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d23ee02e-43ee-40aa-bab7-441bd695c59a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:34.003312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d23ee02e-43ee-40aa-bab7-441bd695c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:34.018782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 434/871] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:33 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:34.035745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4d464-8f23-4700-8fb9-35114ed62d9d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:34.057677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4d464-8f23-4700-8fb9-35114ed62d9d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:34.065995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:34.067298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:34.067827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:34.068337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:34.069877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:34.073349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00d87b-c75e-4678-86ed-44c260e310d6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:34.106275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 438/872] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:34 2022] POST /identity/v3/services => generated 269 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:35.462507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe136a-ede2-4e3b-9a6b-68cb9046c563 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:35.463439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe136a-ede2-4e3b-9a6b-68cb9046c563 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:35.463879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe136a-ede2-4e3b-9a6b-68cb9046c563 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:35.466369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 435/873] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:35.472989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842082-ae16-43eb-9df1-14423df01868 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:35.474036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842082-ae16-43eb-9df1-14423df01868 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:35.474527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842082-ae16-43eb-9df1-14423df01868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:35.503255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2b842082-ae16-43eb-9df1-14423df01868 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:35.505365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2b842082-ae16-43eb-9df1-14423df01868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:35.536138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 439/874] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:35 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:35.559649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe136a-ede2-4e3b-9a6b-68cb9046c563 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:35.573400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe136a-ede2-4e3b-9a6b-68cb9046c563 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:35.578723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:35.579778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:35.580255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:35.580753 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:35.581730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:35.583660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72264dbe-19d1-4456-a2a0-095548c85d1c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:35.603115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 436/875] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:35 2022] POST /identity/v3/services => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:36.670944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241f45-0b5e-49c9-bc9a-f15c4926019c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.670944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241f45-0b5e-49c9-bc9a-f15c4926019c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.670944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241f45-0b5e-49c9-bc9a-f15c4926019c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.674618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 440/876] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:36.684527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a5429-eaf4-43aa-a4e2-ca4dd8322450 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.686055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a5429-eaf4-43aa-a4e2-ca4dd8322450 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.686865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a5429-eaf4-43aa-a4e2-ca4dd8322450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.716621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-956a5429-eaf4-43aa-a4e2-ca4dd8322450 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:36.718923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-956a5429-eaf4-43aa-a4e2-ca4dd8322450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:36.754793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 437/877] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:36 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:36.792323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241f45-0b5e-49c9-bc9a-f15c4926019c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.814293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241f45-0b5e-49c9-bc9a-f15c4926019c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:36.822778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:36.824836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.825751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.826543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.828200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:36.831098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:36.837654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0c80-862f-462c-8778-3c9ee9400d32 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.838273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0c80-862f-462c-8778-3c9ee9400d32 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.838798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0c80-862f-462c-8778-3c9ee9400d32 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.841159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 438/878] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:36.846863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.847385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.847866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.853978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 03:25:36.856415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 441/879] 10.222.0.32 () {56 vars in 1153 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:36.866500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.867383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:36.868809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:36.878584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 439/880] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:36 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:36.889586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1935d-389c-40c2-a286-e31b2126fb8f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:36.897589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:36.898771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.899257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.899744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.901199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:36.901737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:36.904036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.905231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:36.914188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7130e-71d9-451a-864e-abca9335f672 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:36.914404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 442/881] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:36.919948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:36.921340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.922151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.922737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.923597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.923941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:36.925983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:36.938787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 03:25:36.940004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbfd0-d620-4a2b-ba61-f1fcf447c249 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:36.941076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 440/882] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:36.949284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.957466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:36.958552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.959155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.959633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.960645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:36.961162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:36.963178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:36.969727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 443/883] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:36.970705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d664641-3581-4d03-b8be-0a5f702ee71f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:36.975896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:36.976987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:36.977494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:36.978984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.979901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:36.980736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:36.981044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:36.982807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:36.988736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 441/884] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:36.994693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:36.999901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad088-1756-49dc-aeac-804a1674c1cf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.006431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167fb18-a251-4f2d-8760-067f48a65a9b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.008705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.010142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.010907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.011591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.012056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.013113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.013492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.013863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.014290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] RBAC: Adding query filter params (interface=public, service_id=32575bfc6eaa4bc7b9bb35a3272dc72e, region_id=RegionOne) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:37.014864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:37.015269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.015502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.017216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.019079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad023ee-21f6-479c-97d4-7523b390778e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.034709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 442/886] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:37.035193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 444/886] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:36 2022] GET /identity/v3/endpoints?service_id=32575bfc6eaa4bc7b9bb35a3272dc72e&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:37.040621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.059412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca580-9ab1-447c-a253-650f4a040cf4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.068181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.069830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.070612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.071457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.073226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.076965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b04d8-a762-466f-b1a3-56cd2a09a866 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.094808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 443/887] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/services => generated 1268 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:25:37.384156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252e1b-6512-49e1-8837-f4675b9e1a23 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.384543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252e1b-6512-49e1-8837-f4675b9e1a23 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.384881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252e1b-6512-49e1-8837-f4675b9e1a23 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.386779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 445/888] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:37.393877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.394328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.394808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.422673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:37.424566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:37.437793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 444/889] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:37 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:37.473805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252e1b-6512-49e1-8837-f4675b9e1a23 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.495880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252e1b-6512-49e1-8837-f4675b9e1a23 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.503989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.505386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.505939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.506424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.526163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:37.541024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:25:37.543674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 446/890] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:37.552459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.567175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3872-9b36-43e1-b657-5c7eed154da8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.574444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.575616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.576097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.576558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.580785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:37.581323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.584335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.599597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 445/891] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:37.606720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.622720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5323-a2dc-4fba-b058-3fbff6c45008 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.632888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.634897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.635646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.636376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.656909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.661112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.696493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:37.699124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 447/892] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:37.706133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.724975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6503d3e-b2cd-4fdb-a3df-f7515290a9db admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.733485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.734792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.735271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.735737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.737106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:37.737619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.740883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.766922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 446/893] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:37.775887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.793907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce59c-7b20-4163-bf71-7b3e0d1f9259 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.801539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.803029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.803506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.803984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.817961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.822140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.850794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:37.853496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 448/894] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:37.863007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.881516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a49a57-e1cc-4899-b536-45d05a4cb83e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.889874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.891015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.891500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.892029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.893738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:37.894277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.898270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48deb2d-f1c3-42bd-bae2-e092d6621de2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:37.933689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 447/895] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:37.942870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:37.961138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08b6a-7dcd-45ad-8555-6ef0a555203f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:37.969487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:37.970616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:37.971207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:37.971728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:37.987744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:37.991299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.004869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45287-4fe2-4c59-bb4b-99b95297a4f8 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.005317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45287-4fe2-4c59-bb4b-99b95297a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.005729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45287-4fe2-4c59-bb4b-99b95297a4f8 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.009366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 448/896] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:38.009638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 449/897] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:37 2022] GET /identity/v3/auth/tokens => generated 1663 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:25:38.017277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.017757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.018223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.024452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.034404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a330eec-b7e0-4125-88d4-07675144245a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.039307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.040134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.040427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.040677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.052532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:38.052962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.054354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:38.054867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.069190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 449/898] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:38 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:38.075782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:38.077522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 450/899] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:38.085128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.096285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d637920-f4e9-4174-b38a-d31daff79a47 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.101433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.102190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.102442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.102745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.103582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.103884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.105708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.118292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.126645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 450/900] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:38.134800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.137967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14b06-da3e-44b9-8c4c-c992ae237d9a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.146770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78269-d88e-4f41-8606-e672fe778580 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.148374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.150109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.150735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.151358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.152854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.153204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.154235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.154741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.155192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.156754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.165219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.167741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.181145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 03:25:38.183790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 451/901] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:38.184160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:38.185766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 451/902] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:38.194333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.194703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.203019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf4955-92f8-456e-b86c-1e55f25c9de1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.208747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.209433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.209757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.210028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.210928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.211234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.213174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.214610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd379e0-1dcc-4c00-a349-63ecf6d7f818 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.225033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.226459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.227176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.227904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.229467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.230260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.233796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.235603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 452/903] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:38.237110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.248136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f218-f3dd-4e98-994b-1077adc049de admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.248661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 452/904] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:38.253391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.254066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.254362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.254614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.255506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] RBAC: Adding query filter params (role.id=5154c56dca664bf3a0d9ee22af0aad55, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=862a7e9af971415ab1e8c9cb325994f5) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.255675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.255840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.257773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.270817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 453/905] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/role_assignments?user.id=862a7e9af971415ab1e8c9cb325994f5&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=5154c56dca664bf3a0d9ee22af0aad55 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:38.275159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83ebc-4ccd-4224-8428-65af49580dd0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.284152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.285892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.286803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.287645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.290860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.291810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.294267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.303524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 453/906] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:38.313303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.324114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da4ff4-47bc-40ee-9fa5-45c254b10a8b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.328872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.329552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.329832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.330103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.330956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] RBAC: Adding query filter params (interface=public, service_id=37f659e5b90a4684bac3544efa72c873, region_id=RegionOne) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:38.331269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.332939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd125a6-0c47-4d76-b30d-f33c38e8e0d6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.339560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 454/907] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/endpoints?service_id=37f659e5b90a4684bac3544efa72c873&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:38.349527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:38.368467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f407a-dbac-4414-a41f-7404c3401b59 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:38.376746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:38.377868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:38.378288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:38.378773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:38.380042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:38.383682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a88b43-3aad-43e4-9afc-d2504723a461 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:38.396624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 454/908] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:38 2022] GET /identity/v3/services => generated 1268 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:25:39.725910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea4fc-7124-44da-b665-5428e7b32b52 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:39.726710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea4fc-7124-44da-b665-5428e7b32b52 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:39.727047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea4fc-7124-44da-b665-5428e7b32b52 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:39.730136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 455/909] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:39.739478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229d11-4baa-4283-8e4f-29b64a0ac7bb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:39.740102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229d11-4baa-4283-8e4f-29b64a0ac7bb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:39.740694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229d11-4baa-4283-8e4f-29b64a0ac7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:39.772657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-45229d11-4baa-4283-8e4f-29b64a0ac7bb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:39.774700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-45229d11-4baa-4283-8e4f-29b64a0ac7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:39.788318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 455/910] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:39 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:39.827863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea4fc-7124-44da-b665-5428e7b32b52 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:39.850229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea4fc-7124-44da-b665-5428e7b32b52 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:39.857764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:39.858912 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:39.859394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:39.859872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:39.861331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:39.864430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cba67-c701-4454-9cf8-81ab311b2a76 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:39.895645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 456/911] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:39 2022] POST /identity/v3/services => generated 241 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:40.828502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b4e5-88ad-4a35-97a8-c96d0a4e9013 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:40.829298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b4e5-88ad-4a35-97a8-c96d0a4e9013 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:40.829432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b4e5-88ad-4a35-97a8-c96d0a4e9013 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:40.833274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 456/912] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:40.842681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:40.843494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:40.843797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:40.874946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:40.877309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:40.906640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 457/913] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:40 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:40.945739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44b4e5-88ad-4a35-97a8-c96d0a4e9013 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:40.966834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44b4e5-88ad-4a35-97a8-c96d0a4e9013 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:40.974078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:40.975676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:40.976163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:40.976683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:40.977902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:40.980788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.003557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 10 03:25:41.005902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 457/914] 10.222.0.32 () {56 vars in 1153 bytes} [Thu Feb 10 03:25:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:41.015624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.030675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4387cf-dfdc-4a83-85f4-32031cfc5206 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.037569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.038571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.039027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.039446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.040614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:41.041075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.043957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.052946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 458/915] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:41.061411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.078792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02a02-8ec9-4b5c-958a-163ff61a5124 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.086321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.087479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.087948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.088409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.089724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:41.090250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.093389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91e4b-db86-498a-933a-dc20ab64efc3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.111516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 458/916] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:41.120331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.139408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748e0a-1e16-4992-afbc-f8e62466b0fc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.147426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.148598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.149097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.149576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.151143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.154440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b825a1-69a7-4054-85be-4c7aa43af145 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.193466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 459/917] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:41.495375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1a9e-c634-466e-807e-ab032e57ff03 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.495855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1a9e-c634-466e-807e-ab032e57ff03 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.496230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1a9e-c634-466e-807e-ab032e57ff03 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.498546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 459/918] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:41.507375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9c33-3788-4243-a438-cba493e9106d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.507870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9c33-3788-4243-a438-cba493e9106d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.508366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9c33-3788-4243-a438-cba493e9106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.538440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-147a9c33-3788-4243-a438-cba493e9106d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:41.540535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-147a9c33-3788-4243-a438-cba493e9106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:41.574887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 460/919] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:41 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:41.613217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1a9e-c634-466e-807e-ab032e57ff03 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.634691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1a9e-c634-466e-807e-ab032e57ff03 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.642273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.643703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.644178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.644672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.665059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:41.680221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:25:41.690681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 460/920] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:41.693092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9c33-3788-4243-a438-cba493e9106d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.709308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9c33-3788-4243-a438-cba493e9106d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.717227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.718400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.720151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.720151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.720794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:41.721333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.724509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.746981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 461/921] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:41.749179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.765596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984819-361e-4a3f-a7f9-c60310fb42ad admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.772767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.774042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.774517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.774953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.793173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.796695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.825893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-81d27b39-2322-4ed2-9d5d-fb5717e66785 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:41.833194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 461/922] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:41.837219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.852651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7708e-b687-4dae-b7ad-d8ffa7fc7007 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.859947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.861151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.861605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.862068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.863336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:41.863803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.866645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.885689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 462/923] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:41.887311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cab36-e623-4b86-990f-206e1036a70d None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.887771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cab36-e623-4b86-990f-206e1036a70d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.888239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cab36-e623-4b86-990f-206e1036a70d None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.891520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.898685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 462/924] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:41.901566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.902028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242157-e456-463b-ad34-e02a9d4ffd7a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.902217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.902469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.906929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.907767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.908050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.908320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.918105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.920534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.933068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:41.934914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:41.937361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:41.942876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 463/925] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:41.947117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.949693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 463/926] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:41 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:41.962689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77639d95-1225-440b-ab1f-b92a007b372e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:41.966684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:41.966684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:41.966684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:41.966684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:41.967080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:41.967080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:41.968551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:41.988918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 464/927] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:41.992432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:41.994909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.006937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88686-5805-4b6e-a2dd-71f019009e13 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.008511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4e928-38eb-46e8-a410-e17972dd7e00 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.011798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.012685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.012961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.013231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.015702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.016588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.017098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.017547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.018789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.021918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.025975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.028738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.042932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 10 03:25:42.047640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:42.049245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 465/929] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:42.049434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 464/929] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:42.054932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.055986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.065723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f9488-2d9b-420c-b5e5-3867429a20e3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.073941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853830e-9f90-4d03-b25f-89ca78ca8466 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.077259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.078062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.078469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.078782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.079760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.080063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.081250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.081874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.082305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.082802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.083272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.084617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.085136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.087681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 466/930] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:42.089541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.096636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.104951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 465/931] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:42.109919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241f563-65ea-4b70-9f59-305d8411106e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.111230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.112755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.113419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.113694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.113963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.114718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.115028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.116848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.123334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1952735-6f2a-470c-91d5-79c08348c641 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.123800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 467/932] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:42.132665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.133199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.134091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.134613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.135111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.143124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.146051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.150425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0a615-b195-49d2-99ce-2f946287e410 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.158194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.159356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.159848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.160336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.161791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.163349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:42.165038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.170692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 466/933] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:42.172068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.185407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b335ba-bd05-4d2b-89ea-ce1555dc29d0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.193204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.194533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.195628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.196155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.197332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.197986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.200523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d592955-073d-4ffc-a3d7-a67b697f6d47 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.210876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 468/934] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:42.219521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 467/935] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:42.221746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.259013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ae2f-8278-45b8-abb1-bfc0419abef6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.267361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.269179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.269775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.270373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/862a7e9af971415ab1e8c9cb325994f5/roles/5154c56dca664bf3a0d9ee22af0aad55` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.275049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=862a7e9af971415ab1e8c9cb325994f5, role_id=5154c56dca664bf3a0d9ee22af0aad55)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.281004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.286058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4c45-48ec-4dca-8918-d93f98493c6b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.286610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4c45-48ec-4dca-8918-d93f98493c6b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.287068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4c45-48ec-4dca-8918-d93f98493c6b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.290182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 468/936] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:42.299695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.300636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.301125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.314720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 469/937] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:42 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/862a7e9af971415ab1e8c9cb325994f5/roles/5154c56dca664bf3a0d9ee22af0aad55 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:25:42.328071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:42.329719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:42.403093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 469/938] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:42 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:42.444901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.461315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470812d-2a1b-43b3-984c-2fa2611a2e14 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.468471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.469331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.469684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.469899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.470628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.472432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.486576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 03:25:42.488212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 470/939] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:42.494419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.504640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373446-653a-4e7d-a8cb-ae06234faf51 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.509965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.510562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.510878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.511144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.512033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.512429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.514126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.520366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 470/940] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:42.527159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.540814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffaba-f82b-4415-baf6-38a6930572a7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.546488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.547537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.547972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.548392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.549232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.549547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.551332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.557926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 471/941] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:42.564984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.577447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5bef-de5c-49ae-9337-e6f01f7e7081 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.582690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.583638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.584133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.584543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.585560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] RBAC: Adding query filter params (interface=public, service_id=5bdac73a22904ff996529ecee30f2475, region_id=RegionOne) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:42.586045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.587988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c524-0d6c-4396-a498-46e1139bcdee admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.594757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 471/942] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/endpoints?service_id=5bdac73a22904ff996529ecee30f2475&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:42.600741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:42.611868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156824b-c4d5-40cd-859b-f145bbef7ac7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:42.617031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:42.618011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:42.618471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:42.618909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:42.619837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:42.621717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1ad2e-4a48-444f-8b15-2a092feb4982 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:42.629530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 472/943] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:42 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:25:43.620922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1a4d-80e2-4331-a30b-956b16330fa4 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:43.621793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1a4d-80e2-4331-a30b-956b16330fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:43.621978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1a4d-80e2-4331-a30b-956b16330fa4 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:43.626850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 472/944] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:43.636148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:43.636881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:43.637124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:43.670646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:43.672933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:43.688188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 473/945] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:43 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:43.725648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1a4d-80e2-4331-a30b-956b16330fa4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:43.746857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1a4d-80e2-4331-a30b-956b16330fa4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:43.755034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:43.756369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:43.756843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:43.757317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:43.758487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:43.761509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:43.782550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 03:25:43.785174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 473/946] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:43.795206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:43.812078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fdb3f-18eb-4380-8f8f-d1f0eceab2aa None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:43.820093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:43.821253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:43.821735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:43.822234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:43.823687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:43.824352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:43.827705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98b29-ff95-40ae-a3b9-33e106e6ee5b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:43.837747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 474/947] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:43.847276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:43.862764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306f02e-050c-478f-967e-75e53eeae9ea admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:43.870392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:43.871678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:43.872114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:43.872606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:43.874112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:43.874743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:43.878249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c8df-9001-473f-a546-6c7e9fad15ae admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:43.887495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 474/948] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:45.162529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a141-0395-4234-8f7f-854e70cb042b None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.163491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a141-0395-4234-8f7f-854e70cb042b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.163491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a141-0395-4234-8f7f-854e70cb042b None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.165297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 475/949] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:45.171710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.172641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.172641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.193059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:45.194279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:45.202955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 475/950] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:45 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:45.226266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348a141-0395-4234-8f7f-854e70cb042b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.244063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348a141-0395-4234-8f7f-854e70cb042b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:45.250356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:45.251895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.252401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.252890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.253974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:45.256455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:45.270535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 03:25:45.273355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 476/951] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:45.279420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.289025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9428cf-7ab2-4908-9b6b-27f51131e66b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:45.293890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:45.294568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.294890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.295161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.295894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:45.296198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:45.297819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:45.303694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 476/952] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:45.309834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.320692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a1c2-1bac-4633-8c06-0aa8d5ea5c0a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:45.326178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:45.327402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.327889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.328390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.329342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:45.329912 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:45.331815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a82-39fe-4ed6-81ca-4b6293daf168 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:45.338373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 477/953] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:45.344172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.355184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc861-4bb4-4d41-ace0-8b465e751061 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:45.360616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:45.361646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.362186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.362801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.363924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:45.365815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637f223-716d-4a31-afce-a5d709ae7073 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:45.391137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 477/954] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:45.837109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833d07-8975-4042-99b7-1bf90d5aa4e7 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.837822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833d07-8975-4042-99b7-1bf90d5aa4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.838298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833d07-8975-4042-99b7-1bf90d5aa4e7 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.840818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 478/955] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:45.847353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.847989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.848479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.867625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:45.869195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:45.894046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 478/956] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:45 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:45.913641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7833d07-8975-4042-99b7-1bf90d5aa4e7 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.935766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7833d07-8975-4042-99b7-1bf90d5aa4e7 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:45.940890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:45.941878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:45.942357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:45.942884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:45.943812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:45.945882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:45.947521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.common [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 03:25:45.968119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.sql.core [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 10 03:25:45.968119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 10 03:25:45.968119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [parameters: {'id': 'ca3cd2a0ad104e3fbe8a3a44ec1dc3f1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 10 03:25:45.968119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79147) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 03:25:45.975417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca3cd2a0ad104e3fbe8a3a44ec1dc3f1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca3cd2a0ad104e3fbe8a3a44ec1dc3f1. Feb 10 03:25:45.982187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 479/957] 10.222.0.32 () {60 vars in 1161 bytes} [Thu Feb 10 03:25:45 2022] POST /identity/v3/projects => generated 262 bytes in 65 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:45.984874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:45.998243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff6660-51c4-48d5-9641-8a63b87344c3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.006352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.007773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.008251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.008725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.021516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.025440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.050925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-b8183734-3532-4c14-828f-e4db331a5884 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:46.053571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 479/958] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:46.064317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.084496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b07d4-3636-43cb-8318-0029f531734e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.092777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.094470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.095267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.096137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.097856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:46.098792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.103408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1916e-c7f6-4566-9229-30c09ed171cd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.150854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 480/959] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:46.187198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2bc9-babc-4608-b338-becaa2b09c88 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.188010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2bc9-babc-4608-b338-becaa2b09c88 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.188140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2bc9-babc-4608-b338-becaa2b09c88 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.191833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 480/960] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:46.201211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.202007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.202318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.234733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:46.237544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:46.252148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 481/961] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:46 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:46.292202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2bc9-babc-4608-b338-becaa2b09c88 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.312405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2bc9-babc-4608-b338-becaa2b09c88 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.319111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.320490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.320949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.321457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.341252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:46.356378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:25:46.362635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 481/962] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:46.368685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.385658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf4031-0702-4afe-9ea9-fe7c6d7f092d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.394040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.395236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.395726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.396269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.397839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:46.398384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.401522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.417799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 482/963] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:46.426993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.445034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b7edb-0b96-42af-978b-edbc9c421fe4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.453274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.454812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.455374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.455894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.476415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.480097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.512844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:46.515528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 482/964] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:46.524974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.544335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496156-8f90-44d6-a89d-9a4308045eca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.553539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.554683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.555257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.555749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.557250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:46.557808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.561016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.585936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 483/965] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:46.595265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.606837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf6334-b3c7-4733-ae1f-3f9ea79abf39 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.612139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.613375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.613863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.614372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.624080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.627829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.643636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 10 03:25:46.645640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 483/966] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:46.654911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.673577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42776-d6b7-4510-a368-55463d8c0ca5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.682910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.685040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.685633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.686138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.688047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:46.688666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.692576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.729293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 484/967] 10.222.0.32 () {56 vars in 1170 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:46.738424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.755874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45ec1-d03a-4999-b64b-ca9871c87f25 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.763483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.764586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.765081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.765636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.781487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.785042 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.807114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 484/968] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/auth/tokens => generated 2327 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:25:46.812375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.829730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94b4f-f920-4155-93ff-c43b37b8ed7b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.837184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.838612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.839263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.839754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.860930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.863162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.885696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:46.887968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 485/969] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:46.896926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.913533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ed0b3-d79d-41e3-b600-ab6ca24806e6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.921390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.922522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.923121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.923615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.924978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:46.925451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.928678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:46.952420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 485/970] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:46.961478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:46.974046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04148-dc1c-4555-b4a1-741ba8b1e01f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:46.979691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:46.981007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:46.981559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:46.982237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:46.991233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:46.993819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.009089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:47.011011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 486/971] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:47.017493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.033973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a290-b563-4302-b53a-513d724a3a91 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.042347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.044037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.044817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.045564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.047401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:47.048266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.052329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ec06-6f74-45ff-97e1-5246fd6a0b98 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.070230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 486/972] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:47.080963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.099660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89880f2-9aa8-4b7d-8342-0d09c7bf6ed9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.107987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.109519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.110238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.111087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.112798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] RBAC: Adding query filter params (role.id=5154c56dca664bf3a0d9ee22af0aad55, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=862a7e9af971415ab1e8c9cb325994f5) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:47.113610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.117815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd993-6f39-4e1b-a4e7-9a328b42a79e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.131348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 487/973] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/role_assignments?user.id=862a7e9af971415ab1e8c9cb325994f5&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=5154c56dca664bf3a0d9ee22af0aad55 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:47.406775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cb07-dc24-4a7f-ba8a-7b8544612b4c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.408255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cb07-dc24-4a7f-ba8a-7b8544612b4c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.408980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cb07-dc24-4a7f-ba8a-7b8544612b4c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.412821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 487/974] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:47.418742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f4ca-f344-4451-a296-fa8d42653582 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.419474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f4ca-f344-4451-a296-fa8d42653582 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.419474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f4ca-f344-4451-a296-fa8d42653582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.442333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-02e6f4ca-f344-4451-a296-fa8d42653582 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:47.444849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-02e6f4ca-f344-4451-a296-fa8d42653582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:47.458598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 488/975] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:47 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:47.483802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1cb07-dc24-4a7f-ba8a-7b8544612b4c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.499161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1cb07-dc24-4a7f-ba8a-7b8544612b4c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.504951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.505630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.505909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.506215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.507431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.509564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4e14d-5abb-4b8a-a09c-16a9cc138a7c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.534051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 488/976] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:47 2022] POST /identity/v3/services => generated 242 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:47.744596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d845ed-efca-4a3d-babb-d1bff93bdb60 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.744860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d845ed-efca-4a3d-babb-d1bff93bdb60 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.745141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d845ed-efca-4a3d-babb-d1bff93bdb60 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.747323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 489/977] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:47.753540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.753821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.754093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.774959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:47.776227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:47.795656 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 489/978] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:47 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:47.819742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d845ed-efca-4a3d-babb-d1bff93bdb60 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.839027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d845ed-efca-4a3d-babb-d1bff93bdb60 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.846384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.847869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.848373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.848977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.850179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.853150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.875425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 03:25:47.878394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 490/979] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:47.889128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.906014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbe6ce-d926-4e68-b949-6d46497768f3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.913836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.915015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.915510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.915997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.917335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:47.917857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.920982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.927481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 490/980] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:47.934364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.946516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59315728-cfee-457a-a16e-3742fcd4d276 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.952260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.952970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.953322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.953594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.954381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:47.954717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.956480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.963340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 491/981] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:47.969851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:47.982111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5253eb-9380-4c9a-bfad-98b1fae068c7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:47.987861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:47.988689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:47.989156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:47.989440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:47.990384 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] RBAC: Adding query filter params (interface=admin, service_id=5bdac73a22904ff996529ecee30f2475, region_id=RegionOne) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:47.990768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:47.992453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13fdc2-9139-4731-b9fb-6c83a76e434d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:47.999803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 491/982] 10.222.0.32 () {56 vars in 1270 bytes} [Thu Feb 10 03:25:47 2022] GET /identity/v3/endpoints?service_id=5bdac73a22904ff996529ecee30f2475&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:48.006574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:48.019274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288d42b-2c3a-457b-8e38-b9d51ecb6640 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:48.024920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:48.025612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:48.026070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:48.026461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:48.027389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:48.029207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19dce7-0038-4283-9975-ec0e8cf7300d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:48.037665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 492/983] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:48 2022] GET /identity/v3/services => generated 1727 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:25:48.809608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b14-5414-4d7b-bcbc-e970d4a10a09 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:48.810164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b14-5414-4d7b-bcbc-e970d4a10a09 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:48.810164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b14-5414-4d7b-bcbc-e970d4a10a09 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:48.812245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 492/984] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:48.817847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:48.818635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:48.819084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:48.837585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:48.839037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:48.854778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 493/985] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:48 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:48.872940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff566b14-5414-4d7b-bcbc-e970d4a10a09 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:48.886100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff566b14-5414-4d7b-bcbc-e970d4a10a09 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:48.890938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:48.891816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:48.892275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:48.892765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:48.893690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:48.895742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:48.897290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.common [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 10 03:25:48.912278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.sql.core [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 10 03:25:48.912278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 10 03:25:48.912278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [parameters: {'user_id': '4c8e102d23d74013ba8b54e34ee8b119', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 10 03:25:48.912278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 10 03:25:48.928164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 10 03:25:48.933770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 493/986] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:25:48 2022] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:48.936817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:48.947043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8b827-6c8f-4eb9-8520-b0879d5442df None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:48.952203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:48.953346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:48.953804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:48.954292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:48.963432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:48.966051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:48.982420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-0c7f1df4-de66-4194-8c75-971dffb46df0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 10 03:25:48.987967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 494/987] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:48.991812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:49.009221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09314521-9d98-487c-87a7-a9ed95e6aa44 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:49.015486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:49.016523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:49.017011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:49.017483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:49.018511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:49.019012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:49.021422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e75a-4b52-425c-a0da-7240f55a640b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:49.070903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 494/988] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Feb 10 03:25:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:49.893943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0c07-2446-4065-92da-d5a974ec7f4f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:49.894763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0c07-2446-4065-92da-d5a974ec7f4f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:49.894763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0c07-2446-4065-92da-d5a974ec7f4f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:49.896564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 495/989] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:49.902215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:49.902996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:49.902996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:49.922290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:49.923863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:49.932352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 495/990] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:49 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:49.955907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d0c07-2446-4065-92da-d5a974ec7f4f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:49.976883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d0c07-2446-4065-92da-d5a974ec7f4f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:49.984763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:49.986157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:49.986675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:49.987218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:49.988467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:49.991645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.013734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 03:25:50.016140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 496/991] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:50.026108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.042911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642a199-5d55-4d3b-93c4-6d6463310b79 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.050506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.051687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.052182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.052673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.054026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.054574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.057679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.071029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 496/992] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:50.076966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.095152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc73d-fc3f-4c6b-9c32-393954d8c8ae admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.103330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.104453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.104951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.105421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.107051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.107619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.110790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.120602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 497/993] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:50.128682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.146365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59588-b994-4001-b693-64ec3e85db13 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.154117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.155377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.155985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.156532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.158173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] RBAC: Adding query filter params (interface=public, service_id=8aaebc44e7074c94b1b60e3f22eb4b69, region_id=RegionOne) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.158810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.161867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3995f8-d6ec-49df-8652-2ad6208cbc0e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.171945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 497/994] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/endpoints?service_id=8aaebc44e7074c94b1b60e3f22eb4b69&interface=public®ion_id=RegionOne => generated 194 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:50.178712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.190265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3f9cf-cb21-42a9-a3de-302915bff766 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.196370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.197238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.197496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.197888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.198728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.200710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c84869-0f1a-4d26-b934-180367371c1c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.208886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 498/995] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services => generated 1727 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:25:50.498383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c46c-41d4-445f-9fa9-0571a04c10c3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.499082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c46c-41d4-445f-9fa9-0571a04c10c3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.499776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c46c-41d4-445f-9fa9-0571a04c10c3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.503812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 498/996] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:50.510033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.510303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.510575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.530951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:50.532216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:50.541780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 499/997] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:50 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:50.570803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c46c-41d4-445f-9fa9-0571a04c10c3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.591311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c46c-41d4-445f-9fa9-0571a04c10c3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.598289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.599443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.599775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.600069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.600860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.602839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.617714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-5f8088e4-b8ed-40fd-924b-5bbf4fb15ede admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 10 03:25:50.619550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 499/998] 10.222.0.32 () {56 vars in 1147 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:50.627287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.643795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038c9d-559f-403b-b72b-9087d07354aa None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.651191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.651972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.652246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.652512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.653503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.653810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.656054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.664444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 500/999] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:50.671872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba639-3314-4470-b775-aa36070cbe1b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.671872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba639-3314-4470-b775-aa36070cbe1b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.671872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba639-3314-4470-b775-aa36070cbe1b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.673082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.673563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 500/1000] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:50.680837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.681406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.684646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.687123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38132f-2c75-4c0a-aac4-986a513de6eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.692971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.694727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.694727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.694727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.695161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.695327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.697687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.703781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 501/1001] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:50.709719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.715699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:50.717714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:50.724121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6490a-7f4e-4074-95fa-cd423274d026 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.734725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 501/1002] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:50 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:50.734937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.734937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.734937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.735605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.736904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.740481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.755669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.767029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79450dd-ac9e-4985-b524-1d6b1ddf12e8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.768710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 502/1003] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:50.784417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.785441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.785838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.786222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.787055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.788846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.801121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 03:25:50.802983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 502/1004] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services/image => generated 86 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:50.809357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.824100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895db8a8-a356-42ef-8e36-3da1630f1b50 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.831313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.832633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.833281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.833888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.835447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.836125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.839448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5850a1a-0f34-4906-b21b-2d081b4e8273 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.847419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 503/1005] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:50.853607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:50.864395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58bdc7-40ce-4482-ad2d-6863d5728225 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:50.869353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:50.870033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:50.870304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:50.870583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:50.871400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] RBAC: Adding query filter params (type=image) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:50.871699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:50.873353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47987-80c7-4ff8-bf96-38bafa8c0f2a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:50.879591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 503/1006] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:52.515460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d93a-6d5e-4379-9b6d-0cd70cd18a70 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.516023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d93a-6d5e-4379-9b6d-0cd70cd18a70 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.516463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d93a-6d5e-4379-9b6d-0cd70cd18a70 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.520125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 504/1007] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:52.526111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.526775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.526775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.547306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:52.548490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:52.557241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 504/1008] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:52 2022] POST /identity/v3/auth/tokens => generated 2572 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:52.579012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d93a-6d5e-4379-9b6d-0cd70cd18a70 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:52.591559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d93a-6d5e-4379-9b6d-0cd70cd18a70 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:52.596300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:52.597100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.597383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.597644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.598298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:52.599947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:52.611420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 10 03:25:52.617582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 505/1009] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:52.619260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:52.630021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6642e6-8c83-4bf5-a688-948cc6dd4af6 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:52.634920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:52.635591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.635866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.636131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.636852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:52.637197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:52.638844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:52.644579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 505/1010] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:52.650329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:52.660792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dd7b7-b8d6-4d69-84b3-b6bc133bd3b3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:52.665836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:52.666499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.666790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.667057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.667810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:52.668087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:52.671608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770ab52-c757-4458-a51e-917069726a7f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:52.675991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 506/1011] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Feb 10 03:25:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:52.681650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:52.694989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b25-bd2e-4c70-b0ba-01819b1b0f80 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:52.699853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:52.700540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:52.700813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:52.701080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:52.701863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:52.703546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfd06d-a91a-478f-ae5b-4f9b3a761cb4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:52.724999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 506/1012] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:53.450542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e6-97a4-4cb0-bade-96463f1f2617 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.450940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e6-97a4-4cb0-bade-96463f1f2617 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.451404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e6-97a4-4cb0-bade-96463f1f2617 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.454272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 507/1013] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:53.461891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e40-2277-4df4-bcf7-b27a0ff4cdaf None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.462233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e40-2277-4df4-bcf7-b27a0ff4cdaf None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.462488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e40-2277-4df4-bcf7-b27a0ff4cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.610589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-21bb8e40-2277-4df4-bcf7-b27a0ff4cdaf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:53.611838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-21bb8e40-2277-4df4-bcf7-b27a0ff4cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:53.631547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 507/1014] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:53 2022] POST /identity/v3/auth/tokens => generated 2728 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:53.656115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d653e6-97a4-4cb0-bade-96463f1f2617 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:53.669799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96e33-0911-4335-9bca-fc8356d542a2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.670064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96e33-0911-4335-9bca-fc8356d542a2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.670452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96e33-0911-4335-9bca-fc8356d542a2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.673422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 508/1015] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:25:53.676971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d653e6-97a4-4cb0-bade-96463f1f2617 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:53.679164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.679446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.679731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.689594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:53.691063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.691551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.692001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.693950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:53.697107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:53.698407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:53.699716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:53.700385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 508/1016] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:53.706888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:53.710623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 509/1017] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:53 2022] POST /identity/v3/auth/tokens => generated 2728 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:53.725336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cedc5-1bcd-4b32-bed0-e1fd8d556564 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:53.731199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:53.731992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.732731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.733590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.733716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:53.734867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:53.737441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd95a1-f408-43b1-84d4-97ce2fcb0bbe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:53.746223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94bcc4-9244-4d88-a68f-3654cd8d186a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:53.752771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:53.753486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:53.753708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:53.753977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:53.754766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:53.756400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17abc53-108a-4ffe-915d-6f37a5bbbe56 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:53.779164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 510/1018] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:53 2022] POST /identity/v3/services => generated 242 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:53.785444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 509/1019] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:25:53 2022] POST /identity/v3/projects => generated 311 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:55.092618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b328c-394f-4648-bb8b-a6f2d783b54e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.093211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b328c-394f-4648-bb8b-a6f2d783b54e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.093211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b328c-394f-4648-bb8b-a6f2d783b54e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.095131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 511/1020] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:55.100613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.101082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.101157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.118488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:55.119703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:55.190006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 510/1021] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:55 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:55.212663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b328c-394f-4648-bb8b-a6f2d783b54e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.225679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b328c-394f-4648-bb8b-a6f2d783b54e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.230223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.231120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.231421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.231692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.242945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:55.250394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:25:55.253364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 512/1022] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:55.257984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.267383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1becd-dcd5-4ca7-9d0c-7a3f7ed931bf None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.272436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.273113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.273396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.273667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.274430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.274762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.276377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.285235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 511/1023] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:55.290846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.301329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a43b2-0066-4381-b13d-3a9c397d61fb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.305958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.306794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.307070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.307337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.319113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.320978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.338698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:55.340174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 513/1024] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:55.345930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.356586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5616de-cde9-4b48-bdab-a48d4f410fa4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.363330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.364556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.365133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.365709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.367107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.367601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.369897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.384005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 512/1025] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:55.389878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.400070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de67f-6473-420c-8985-1cd093e92884 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.405210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.406019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.406269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.406559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.414797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.416833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.431970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:55.433189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 514/1026] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:55.439554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.450625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700290f-1195-4c8a-9dc0-37aa872db5eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.455879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.456741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.457190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.457615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.458683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.459156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.461211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.486416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 513/1027] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:55.488133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.498249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06523e2c-8163-4cad-b1a6-d1794d28ede9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.503722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.504468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.504746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.505011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.513994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.515793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.525418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 515/1028] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:25:55.531541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.543362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaa283-4200-4613-aae3-4103f37ff7f7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.548603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.549507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.549855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.550194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.561804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.563692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.581290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:55.582899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 514/1029] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:55.588488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.598372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb875d6-4612-48fb-9b0d-b39bec9627d2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.603032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.603990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.604101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.604387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.605187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.605584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.607280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.621399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 516/1030] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:55.627687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.638099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174571-58e6-4fba-870d-9ebba64c2459 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.642993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.643805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.644094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.644362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.652379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.654330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.668163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:55.671878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 515/1031] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:55.678226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.696198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d592-e74c-49f2-87f7-75edd17e53cd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.703629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.704884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.705491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.706094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.707803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.708528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.712247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281d1fd-fcdf-41a3-9332-8b35bab54792 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.736381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 517/1032] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:55.737789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:55.749606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff0dbf-3927-46f7-98cc-1df1a83767e2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:55.756585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:55.757289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:55.757731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:55.758003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:55.758901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] RBAC: Adding query filter params (role.id=5154c56dca664bf3a0d9ee22af0aad55, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:55.759212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:55.761198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41754ae-f6c2-4850-b5c0-28c0c632cf14 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:55.768326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 516/1033] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:55 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=5154c56dca664bf3a0d9ee22af0aad55 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:56.083817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1029-291c-4a5c-a968-36dddec7d9ff None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.084078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1029-291c-4a5c-a968-36dddec7d9ff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.084331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1029-291c-4a5c-a968-36dddec7d9ff None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.086341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 518/1034] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:56.092199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0188-7d04-4ddc-b8b5-c30ff5617ca6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.092622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0188-7d04-4ddc-b8b5-c30ff5617ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.092995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0188-7d04-4ddc-b8b5-c30ff5617ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.111914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a6eb0188-7d04-4ddc-b8b5-c30ff5617ca6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:56.113123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a6eb0188-7d04-4ddc-b8b5-c30ff5617ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:56.121795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 517/1035] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:56 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:56.135689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d004-c1d1-4257-8ed7-a54c8b115b86 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.136218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d004-c1d1-4257-8ed7-a54c8b115b86 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.136218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d004-c1d1-4257-8ed7-a54c8b115b86 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.138274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 519/1036] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:56.144011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.144338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.144648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.146837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d004-c1d1-4257-8ed7-a54c8b115b86 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.159819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d004-c1d1-4257-8ed7-a54c8b115b86 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.164682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:56.164813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.165519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.165793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.165977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:56.166086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] PATH_INFO: `/v3/services/image` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.166735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.168422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.174799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 518/1037] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:56 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:56.180145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 03:25:56.181460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 520/1038] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:56.187761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.197315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f322456-a796-4414-a4de-c609fa7f0163 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.199465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.202008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.202753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.203035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.203305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.204024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:56.204387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.205983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.209546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed96d-7d59-4e73-b7dd-147df167f6bc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.211458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 519/1039] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:56.214675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.215620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.215902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.216172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.217403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.217800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.219672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.221295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 521/1040] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:56.227950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.235270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119da101-4ea3-4381-89d2-2b3bf2cafdd0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.237905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324dffd-fcea-412c-97de-b614f76f7d05 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.240505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.241278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.241667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.241947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.242663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] RBAC: Adding query filter params (type=image) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:56.242762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.242998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.243380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.243638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.243918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.244763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.244868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.246606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.250388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 520/1041] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:56.256772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.269108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39998-2276-4a09-8db0-78bc34cb636a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.269368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 522/1042] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:25:56 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:25:56.282236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.282997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.283279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.283550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.284409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] RBAC: Adding query filter params (interface=public, service_id=f45cd045b03e43cbb37dd68ed089a7c5, region_id=RegionOne) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:56.284724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.286377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38079097-27b4-4701-b25c-81bdf008124e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.292544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 521/1043] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/endpoints?service_id=f45cd045b03e43cbb37dd68ed089a7c5&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:56.298377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:56.309665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f547f-0762-420d-b098-5bf170dd22e0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:56.314684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:56.315525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:56.315900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:56.316266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:56.317082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:56.318894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7e85c-415e-42ba-8da2-40098889f221 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:56.326491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 523/1044] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:25:56 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:25:58.031374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc133-00cb-4fd5-8ed3-a4bd9030cae2 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.031880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc133-00cb-4fd5-8ed3-a4bd9030cae2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.031880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc133-00cb-4fd5-8ed3-a4bd9030cae2 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.033763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 522/1045] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:58.039248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.039699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.039783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.057674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:58.058931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:58.067200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 524/1046] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:58 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:25:58.090030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbc133-00cb-4fd5-8ed3-a4bd9030cae2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.104117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbc133-00cb-4fd5-8ed3-a4bd9030cae2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.113793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.114629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.114948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.115220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.126590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:58.134202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:25:58.136111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 523/1047] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:58.143732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.153786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39bd6-9420-4f5b-823b-a5da71d9c8fe None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.159203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.159971 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.160423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.160621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.161491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.161859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.163711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.178683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 525/1048] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:58.182946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.194240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade23f-d85f-45b1-9af1-9a7f966a31fa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.200235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.201060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.201339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.201611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.214232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.216141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.234593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:58.236091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 524/1049] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:58.242681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.253809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32bb7d-4ee0-4c31-a340-79b2a8401f9d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.259399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.260146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.260512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.260954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.261681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.262133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.263856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.277678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 526/1050] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:58.283571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.295526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc723ec-0076-4449-9e32-42929ee92f36 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.300861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.301860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.302238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.302594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.312405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.314913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.331864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:25:58.338499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 525/1051] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:58.339639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.350214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b57-4554-4fd6-b682-e469128e6d8b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.355239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.356124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.356403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.356651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.357644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.357953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.359899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.382074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 527/1052] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.387889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.398251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279abb6-62df-410f-8715-3ff484b24a23 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.403297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.404225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.404603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.404907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.416934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.418945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.437705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:25:58.439231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 526/1053] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:58.445080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.456362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf20e4-e61b-44a6-a757-a6ad49501be0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.461605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.462493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.462968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.463292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.464200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.464588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.466467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.480866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 528/1054] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.486594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.497576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabd478-9424-434a-8c72-cf2d57c75d62 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.502988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.503903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.504179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.504507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.512422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.514462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.528777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:25:58.530265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 527/1055] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:25:58.536884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.553519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78039aa-3386-4d50-b01c-0713955dcf20 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.560813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.561818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.562169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.562509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.563437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.563806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.565738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9c37c-9819-494c-8247-eb5ea500904d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.580220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 529/1056] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.584748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.587175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c58ab-10b2-4336-aa99-db41e7e827e7 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.587457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c58ab-10b2-4336-aa99-db41e7e827e7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.587732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c58ab-10b2-4336-aa99-db41e7e827e7 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.589546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 530/1057] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:58.595054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.595334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.595609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.596661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a79f-5916-444d-a02c-d5d5dc949f1e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.601486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.602494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.603554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.603554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/5154c56dca664bf3a0d9ee22af0aad55` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.605656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=74c6cf5d4bba4126a0a94a4db29dee52, role_id=5154c56dca664bf3a0d9ee22af0aad55)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.608606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb475-c9a5-475f-b082-e2cff6832317 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.614401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:58.615649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:58.623289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 528/1058] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:25:58 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/74c6cf5d4bba4126a0a94a4db29dee52/roles/5154c56dca664bf3a0d9ee22af0aad55 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:25:58.626900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f743-6070-4273-af0b-1f25b0071d99 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.626900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f743-6070-4273-af0b-1f25b0071d99 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.626900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f743-6070-4273-af0b-1f25b0071d99 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.627822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 529/1059] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:25:58.634081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.634444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.634622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.654600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:25:58.655935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:25:58.695059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 531/1060] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:58 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:58.719762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.723023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 530/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:25:58 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:25:58.729839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2206-a768-4ca6-ada2-d5edb80752a1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.734545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.735398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.735657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.735918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.747183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.748065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:25:58.756970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b524b5-07e9-4162-97ec-7f97bd17bb30 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.757295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:25:58.759289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 532/1062] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:58.762212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.763084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.763364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.763642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.764343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.766432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.766944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.777978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44dc4f-3a31-4aed-9e0b-9bc6ec39a993 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.778791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 10 03:25:58.780479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 531/1063] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:25:58.783943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.784825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.785250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.785659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.786571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.786761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.787258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.789026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.797488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349799e-d2d2-4872-9e2d-fc2a08df0632 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.800519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 533/1064] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.802915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.803921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.804387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.804824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.805770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.806260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.808432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.809078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.815068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 532/1065] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:58.821010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de92dc-db24-4d47-8313-09add7b76d4d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.821655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.829047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.830692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.830985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.831412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] PATH_INFO: `/v3/users/902013acb7ce49168f0bfe0482925361` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.834247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cceed-7847-4453-b7f2-8c13617c3a58 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.841054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.842094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.842528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.842985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.844579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.844579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.847235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.853466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=902013acb7ce49168f0bfe0482925361)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.856153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 533/1066] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:25:58.856842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.862431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 534/1067] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/users/902013acb7ce49168f0bfe0482925361 => generated 285 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.863002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.865952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.874686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844d043-e3ba-46b4-a51c-bc7d2955f8b5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.878416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96d83-c0c8-409f-9653-b66aab5a33c7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.880090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.880846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.881275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.881713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.882675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.884568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.885838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.886551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.887056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.887413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.900142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.903032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.908904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 534/1068] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:25:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:25:58.914518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 535/1069] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:25:58.920631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.946801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3bcfa-8c1d-4e1c-bbd4-56c61ce89cdc admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.952345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.953530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.953930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.954336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.955992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.958344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77f1b7-d246-4756-bea9-d3ed2136b616 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.965809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 535/1070] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:25:58.967641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:25:58.977808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3804c-cd15-4390-ae58-f37c10848f43 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:25:58.983859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:25:58.984758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:25:58.985245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:25:58.985729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:25:58.986939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=3cfa561859fe453c97a9b240dff81f69, user.id=902013acb7ce49168f0bfe0482925361) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:25:58.987400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:25:58.989550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095354c4-6f9d-46b2-a59d-a2da7193e28e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:25:58.998795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 536/1071] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:25:58 2022] GET /identity/v3/role_assignments?user.id=902013acb7ce49168f0bfe0482925361&scope.project.id=3cfa561859fe453c97a9b240dff81f69&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:00.885423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd563f-2e56-4781-99cd-e00bc5ecb08d None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:00.886188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd563f-2e56-4781-99cd-e00bc5ecb08d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:00.886188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd563f-2e56-4781-99cd-e00bc5ecb08d None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:00.891924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 536/1072] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:00.893844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:00.894306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:00.894397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:00.913626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:00.914891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:00.923661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 537/1073] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:00.949542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd563f-2e56-4781-99cd-e00bc5ecb08d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:00.967531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd563f-2e56-4781-99cd-e00bc5ecb08d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:00.973040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:00.973916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:00.974196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:00.974432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:00.988545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:00.996436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 10 03:26:00.997968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 537/1074] 10.222.0.32 () {56 vars in 1141 bytes} [Thu Feb 10 03:26:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:01.004430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.017581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1bb26-7809-4cf1-9b46-cdd601ff9522 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.024233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.025170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.025610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.026025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.027459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.027957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.034792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.046711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 538/1075] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.050054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.061518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da23b3-2356-463a-9cca-84550e519e38 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.066555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.067599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.067971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.068346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.081970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.084958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.104765 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:26:01.106525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 538/1076] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:01.112622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.126646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c2d81-47fd-472f-ac2f-19d8b884065e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.133892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.135181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.135662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.136206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.137266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.137713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.140425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.157276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 539/1077] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.163086 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.177422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c1f7-1229-416a-af6b-30f0ad589111 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.182485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.183437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.183817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.184190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.192665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.194921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.210512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-71937095-7a94-4826-b0a0-3b2261a76f42 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 10 03:26:01.212221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 539/1078] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:01.218102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.228994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfa8bf-f938-43be-b6ae-03d21133c454 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.235143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.235959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.236336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.236700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.237681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.238102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.240119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2fe56-f4ff-4ad0-b0a5-89250db29b7a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.247709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f3330-ad15-4d65-968c-6d4294df844c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.247996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f3330-ad15-4d65-968c-6d4294df844c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.248276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f3330-ad15-4d65-968c-6d4294df844c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.250676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 540/1079] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:01.252291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224017f-373d-49f4-8e24-5c95f3e7db85 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.252643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224017f-373d-49f4-8e24-5c95f3e7db85 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.252941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224017f-373d-49f4-8e24-5c95f3e7db85 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.254746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 541/1080] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:01.258288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.258570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.258890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.269970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 540/1081] 10.222.0.32 () {56 vars in 1154 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.269970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.269970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.269970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.280301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:01.281672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:01.285078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:01.286247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:01.291698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 542/1082] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:26:01.292530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.295212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 541/1083] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:01.302279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd13b08-7ae9-44e2-9e6b-fc05631b8daa None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.307287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.308027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.308368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.308721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.317424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.319775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.321585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.327523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bd8d2-6d7a-40b5-87d8-414a5d22065b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.332309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.333156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.333433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.333686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.339273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 543/1084] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:01.339273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.345912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:01.350151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6375-b868-44bd-b772-eabedddc9c00 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.357485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.358458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.358772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:01.358942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.359381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.361174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 542/1085] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:26:01.362377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.372944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.376427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.379043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955dae-bf89-4a40-8836-7f1b59c6f737 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.386760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.387975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.388428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.388879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.391557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 544/1086] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:01.394088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.404232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064432c9-d955-4c44-ad63-f34941971568 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.404468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.406247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.409945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.410618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.410932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.411196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.411957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.412271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.413858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.423095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 545/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.423616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:26:01.423872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.424941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 543/1088] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:01.430174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.433963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c83-14ff-403a-9ab5-efba5cc6a046 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.439450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.439713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a84dfb-7c5f-40ef-bd9f-efe33bea24bc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.440246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.440526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.440792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.442065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.443797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.444244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.445096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.445363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.445482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 546/1089] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.445646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] PATH_INFO: `/v3/users/902013acb7ce49168f0bfe0482925361` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.446101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.446998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] RBAC: Authorizing `identity:get_user(user_id=902013acb7ce49168f0bfe0482925361)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.449327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.451556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 544/1090] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/users/902013acb7ce49168f0bfe0482925361 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.458301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.460047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d0de6-6a7d-4fb6-9c0f-2de6df54b649 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.465120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.465925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.466268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.466603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.467399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.467710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.469364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.469488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46e465-f968-41f7-9b45-36216ebe53fa admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.474520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.475544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.475891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.476232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.477690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.479894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.481744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 545/1091] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.483449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 547/1092] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.489011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.492511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.499440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b4e5b-3584-43bf-a38c-980a3c38dc02 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.503256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82080e2-afeb-4d04-8ea1-36de41901bdb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.504840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.505820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.506174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.506504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69/users/902013acb7ce49168f0bfe0482925361/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.508671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.508815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfa561859fe453c97a9b240dff81f69, user_id=902013acb7ce49168f0bfe0482925361, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.509502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.509782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.510052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.511796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.518177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.520192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.527011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 546/1093] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:26:01 2022] PUT /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69/users/902013acb7ce49168f0bfe0482925361/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:26:01.534374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:26:01.538692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 548/1094] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:01.543070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.615184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d1dc-e30c-4296-a747-36114778ce2b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.620676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.621707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.622152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.622564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.623622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.624171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.626733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933db6-77ce-45be-afa4-21a909222d59 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.641082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 547/1095] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:01.647289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:01.659855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b267-243c-4ce5-8c29-7ea7e152de3f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:01.671224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:01.672099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:01.672503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:01.672879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:01.674222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] RBAC: Adding query filter params (role.id=5154c56dca664bf3a0d9ee22af0aad55, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=74c6cf5d4bba4126a0a94a4db29dee52) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:01.674222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:01.676556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ce734-0591-479b-9298-1c215cda3d98 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:01.684962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 549/1096] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:01 2022] GET /identity/v3/role_assignments?user.id=74c6cf5d4bba4126a0a94a4db29dee52&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=5154c56dca664bf3a0d9ee22af0aad55 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:03.754330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df866a-5df7-4d4b-bd4e-1e51cbc08a65 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.754940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df866a-5df7-4d4b-bd4e-1e51cbc08a65 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.754940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df866a-5df7-4d4b-bd4e-1e51cbc08a65 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.756676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 548/1097] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:03.762462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.762914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.763033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.781350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:03.782528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:03.793374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 550/1098] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:03.817463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df866a-5df7-4d4b-bd4e-1e51cbc08a65 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:03.831561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df866a-5df7-4d4b-bd4e-1e51cbc08a65 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:03.836776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:03.837566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.837846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.838113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.849310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:03.856250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:03.857406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 549/1099] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:03.863627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:03.872722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832992a4-463d-4a24-a880-9a23974a8091 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:03.877807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:03.878458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.878770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.879042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.879802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:03.880103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:03.881685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:03.889957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 551/1100] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:03.895697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:03.906112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8666f-746e-4413-b1df-34aeccc838f4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:03.911068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:03.911898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.912170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.912430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] PATH_INFO: `/v3/users/902013acb7ce49168f0bfe0482925361` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.913670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] RBAC: Authorizing `identity:get_user(user_id=902013acb7ce49168f0bfe0482925361)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:03.915877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:03.917409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 550/1101] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/users/902013acb7ce49168f0bfe0482925361 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:26:03.923108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:03.933097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2511235-52e3-47a9-9bac-be61eb2fa0f2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:03.938121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:03.938775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.939055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.939317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.947133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:03.948856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:03.957581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 552/1102] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:03.963359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:03.977713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7fd22-a974-4af4-bc62-00de87001332 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:03.982945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:03.983792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:03.984063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:03.984320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:03.985531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:03.987602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d14aa-538f-400e-a0d9-f7b33e1c11dc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:03.989265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 551/1103] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:03.995501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:04.005361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88d4f-c590-4b48-b3d1-6ffceb96ea5e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:04.011992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:04.012954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:04.013265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:04.013541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:04.014372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=3cfa561859fe453c97a9b240dff81f69, user.id=902013acb7ce49168f0bfe0482925361) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:04.014682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:04.016540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d641d-7b67-4c3f-8003-84c8050778f5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:04.024259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 553/1104] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:03 2022] GET /identity/v3/role_assignments?user.id=902013acb7ce49168f0bfe0482925361&scope.project.id=3cfa561859fe453c97a9b240dff81f69&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:06.253052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb20e27-7efc-4973-b448-d96ec9fd5211 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:06.253648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb20e27-7efc-4973-b448-d96ec9fd5211 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:06.253648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb20e27-7efc-4973-b448-d96ec9fd5211 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:06.255411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 552/1105] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:06.260875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:06.261709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:06.261709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:06.280644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:06.281846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:06.290413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 554/1106] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:06.315906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb20e27-7efc-4973-b448-d96ec9fd5211 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:06.330159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb20e27-7efc-4973-b448-d96ec9fd5211 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:06.334924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:06.335714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:06.335995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:06.336261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:06.337491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:06.339222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf68053-66c6-43be-9d6a-03ef1ebd5751 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:06.340781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 553/1107] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:06.346469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:06.355908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba20d7-e7b6-47df-b8ab-43504b2b5a55 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:06.361675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:06.362345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:06.362623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:06.362929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:06.363660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:06.365578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417ca56-ec01-4906-9601-14ec7808542e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:06.387812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 555/1108] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:26:06 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:26:08.660763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597951f-2863-4f7c-86cd-c9c6e8676c8e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.663523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597951f-2863-4f7c-86cd-c9c6e8676c8e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.663523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597951f-2863-4f7c-86cd-c9c6e8676c8e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.663523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 554/1109] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:08.669165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.669631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.669735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.690015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:08.691241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:08.700091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 556/1110] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:08.724453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597951f-2863-4f7c-86cd-c9c6e8676c8e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:08.738644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597951f-2863-4f7c-86cd-c9c6e8676c8e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:08.743751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:08.744596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.744874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.745137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] PATH_INFO: `/v3/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.746683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] RBAC: Authorizing `identity:get_role(role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:08.747736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:26:08.747736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:26:08.747736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:26:08.748621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:08.749943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 555/1111] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:08 2022] GET /identity/v3/roles/8eff1ce623524530832effb4e96fb820 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:08.756083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:08.765407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36371244-c332-47cc-a3b4-bf31046dee13 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:08.771253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:08.772124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.772408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.772679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] PATH_INFO: `/v3/users/183bcab372f34da5ba4e9132bc73eb0c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.787519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] RBAC: Authorizing `identity:get_user(user_id=183bcab372f34da5ba4e9132bc73eb0c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:08.789669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:08.791333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 557/1112] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:08 2022] GET /identity/v3/users/183bcab372f34da5ba4e9132bc73eb0c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:08.797315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:08.807676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc46ce-e0bd-4765-8b4f-074b28188e72 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:08.813568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:08.814210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.814493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.814796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.823463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:08.825296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:08.834675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 556/1113] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:08.840902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:08.851400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e213e3-4afc-44bc-bb2a-638c83341b5a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:08.857322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:08.858183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.858465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.858773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.859969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:08.862021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b264-5d3f-4bc2-8e5b-a0afee1234fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:08.863718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 558/1114] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:08 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:08.869960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:08.879455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8e28-cc5f-4f4d-8bd1-d5021803f642 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:08.884500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:08.885132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:08.885407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:08.885680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:08.886608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=3cfa561859fe453c97a9b240dff81f69, user.id=183bcab372f34da5ba4e9132bc73eb0c) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:08.886948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:08.888770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d9e6b-3fab-495f-8133-507ad6ce66d1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:08.894138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 557/1115] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:08 2022] GET /identity/v3/role_assignments?user.id=183bcab372f34da5ba4e9132bc73eb0c&scope.project.id=3cfa561859fe453c97a9b240dff81f69&role.id=8eff1ce623524530832effb4e96fb820 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:11.081639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999b38-670e-4c52-a1fb-c559b7de1f0f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.082216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999b38-670e-4c52-a1fb-c559b7de1f0f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.082216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999b38-670e-4c52-a1fb-c559b7de1f0f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.084016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 559/1116] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:11.089414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.089876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.089973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.108938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:11.110134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:11.118999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 558/1117] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:11.142585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6999b38-670e-4c52-a1fb-c559b7de1f0f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:11.156616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6999b38-670e-4c52-a1fb-c559b7de1f0f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:11.161844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:11.162694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.162998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.163276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] PATH_INFO: `/v3/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.164760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] RBAC: Authorizing `identity:get_role(role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:11.165779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:26:11.165779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:26:11.165779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:26:11.166690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:11.168121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 560/1118] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:11 2022] GET /identity/v3/roles/8eff1ce623524530832effb4e96fb820 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:11.173705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:11.183028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c71b-5f8c-4762-92fd-9dc8b1688a85 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:11.188361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:11.189226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.189500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.189767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] PATH_INFO: `/v3/users/183bcab372f34da5ba4e9132bc73eb0c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.191148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=183bcab372f34da5ba4e9132bc73eb0c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:11.193274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:11.194880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 559/1119] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:11 2022] GET /identity/v3/users/183bcab372f34da5ba4e9132bc73eb0c => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:11.200327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:11.210399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78faea-444b-4436-9f1c-71237df5ac08 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:11.216343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:11.217176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.217451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.217721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.219077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:11.221094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4bbae-2a41-4384-999a-29e3574f19e4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:11.222745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 561/1120] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:11 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:11.228679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:11.239124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda290a9-f121-469d-b006-55b1f49d3bd9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:11.244967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:11.245962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:11.246240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:11.246517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69/users/183bcab372f34da5ba4e9132bc73eb0c/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:11.249236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfa561859fe453c97a9b240dff81f69, user_id=183bcab372f34da5ba4e9132bc73eb0c, role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:11.252288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c51e-9409-49a8-bb04-3898bf180695 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:11.266902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 560/1121] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:26:11 2022] PUT /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69/users/183bcab372f34da5ba4e9132bc73eb0c/roles/8eff1ce623524530832effb4e96fb820 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:26:13.451718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a87ce-e1fd-4594-81f5-fac78cb03607 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.452285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a87ce-e1fd-4594-81f5-fac78cb03607 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.452285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a87ce-e1fd-4594-81f5-fac78cb03607 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.454109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 562/1122] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:13.460180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.460653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.460743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.479046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:13.480246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:13.542216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 561/1123] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:13.566551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a87ce-e1fd-4594-81f5-fac78cb03607 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:13.580760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a87ce-e1fd-4594-81f5-fac78cb03607 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:13.586011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:13.586893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.587183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.587460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] PATH_INFO: `/v3/roles/8eff1ce623524530832effb4e96fb820` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.589011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] RBAC: Authorizing `identity:get_role(role_id=8eff1ce623524530832effb4e96fb820)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:13.590768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:13.592107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 563/1124] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:13 2022] GET /identity/v3/roles/8eff1ce623524530832effb4e96fb820 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:13.597717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:13.606805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b4e6-a0c6-4a79-b12c-b6d5edbf2ced None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:13.611821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:13.612680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.612956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.613228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] PATH_INFO: `/v3/users/183bcab372f34da5ba4e9132bc73eb0c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.614507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] RBAC: Authorizing `identity:get_user(user_id=183bcab372f34da5ba4e9132bc73eb0c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:13.616655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:13.618220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 562/1125] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:13 2022] GET /identity/v3/users/183bcab372f34da5ba4e9132bc73eb0c => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:13.623794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:13.634338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8feb4-48a0-455b-a7ac-ff904ead8ef0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:13.640280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:13.640904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.641183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.641457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.649758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:13.651538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:13.660813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 564/1126] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:13.666638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:13.676591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2643c-bb9d-4058-8dd2-1e1a5b132999 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:13.681626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:13.682449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.682754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.683029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] PATH_INFO: `/v3/projects/3cfa561859fe453c97a9b240dff81f69` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.684383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] RBAC: Authorizing `identity:get_project(project_id=3cfa561859fe453c97a9b240dff81f69)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:13.686472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd721ab-d8c1-42f1-8566-124e95c9557d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:13.688223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 563/1127] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:13 2022] GET /identity/v3/projects/3cfa561859fe453c97a9b240dff81f69 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:26:13.694432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:13.704963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1d66-2be1-4640-8401-0a670901b39d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:13.714149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:13.714897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:13.715182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:13.715457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:13.716303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] RBAC: Adding query filter params (role.id=8eff1ce623524530832effb4e96fb820, scope.project.id=3cfa561859fe453c97a9b240dff81f69, user.id=183bcab372f34da5ba4e9132bc73eb0c) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:13.716614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:13.718462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35be6e-e3c3-4ea4-9d77-0c91e2dd30fc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:13.724696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 565/1128] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:13 2022] GET /identity/v3/role_assignments?user.id=183bcab372f34da5ba4e9132bc73eb0c&scope.project.id=3cfa561859fe453c97a9b240dff81f69&role.id=8eff1ce623524530832effb4e96fb820 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:15.965511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330725-9baa-44eb-83e7-079d4e89fd20 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:15.966064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330725-9baa-44eb-83e7-079d4e89fd20 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:15.966064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330725-9baa-44eb-83e7-079d4e89fd20 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:15.967761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 564/1129] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:15.973262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:15.973705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:15.973806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:15.992410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:15.993608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:16.003454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 566/1130] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:16.027454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330725-9baa-44eb-83e7-079d4e89fd20 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:16.040910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330725-9baa-44eb-83e7-079d4e89fd20 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:16.045940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:16.046765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:16.047036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:16.047298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:16.048489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:16.050174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bad141-7091-4be1-8968-350c3396defa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:16.051746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 565/1131] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:16.057711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:16.067386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5d503-9400-4581-81b3-c1f04d374bd3 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:16.072620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:16.073277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:16.073561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:16.073880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:16.074606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:16.076541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05fb9f-6d86-4bc2-b35a-703285311c08 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:16.103906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 567/1132] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:26:16 2022] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:26:18.344647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4cfc-cb9a-4171-9eab-37a18df451d0 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:18.345284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4cfc-cb9a-4171-9eab-37a18df451d0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:18.345387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4cfc-cb9a-4171-9eab-37a18df451d0 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:18.347859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 566/1133] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:18.353584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:18.354034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:18.354126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:18.373011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:18.374213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:18.433943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 568/1134] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:18.459353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4cfc-cb9a-4171-9eab-37a18df451d0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:18.473482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4cfc-cb9a-4171-9eab-37a18df451d0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:18.478807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:18.479600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:18.479965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:18.480233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:18.481491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:18.483217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5111a-9bde-4e57-be41-6dc01332153f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:18.484780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 567/1135] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:18.490337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:18.499741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240bbeb-09f7-4afb-9456-f40e7bf36910 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:18.505989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:18.506714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:18.507048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:18.507321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:18.508048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:18.509973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe94c-9ef9-4c76-9f5b-62330ad0d0f0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:18.537870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 569/1136] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:26:18 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:26:20.792760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942567e0-529e-4c89-a303-7729d5c57d31 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.793313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942567e0-529e-4c89-a303-7729d5c57d31 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.793313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942567e0-529e-4c89-a303-7729d5c57d31 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.795074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 568/1137] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:20.800579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.801059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.801151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.819155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:20.820328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:20.828581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 570/1138] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:20.852420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942567e0-529e-4c89-a303-7729d5c57d31 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:20.865293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942567e0-529e-4c89-a303-7729d5c57d31 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:20.870052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:20.870883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.871153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.871414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.882316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:20.889277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:20.890410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 569/1139] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:20.896563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:20.906038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e886b-914c-405a-a745-c75cdf5755b8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:20.912245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:20.912908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.913187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.913454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.914215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:20.914519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:20.916158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:20.924906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 571/1140] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:20.930388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:20.940583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d54614-fdc5-4011-ad74-cecf6864db3e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:20.945529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:20.946368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.946634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.946929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] PATH_INFO: `/v3/users/a17e89df91954f349b4e760a080cdbdf` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.960088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] RBAC: Authorizing `identity:get_user(user_id=a17e89df91954f349b4e760a080cdbdf)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:20.962213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:20.963830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 570/1141] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:20 2022] GET /identity/v3/users/a17e89df91954f349b4e760a080cdbdf => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:20.969661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:20.979918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba63a1-8da0-4877-ad20-cbc1d7a064c4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:20.985764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:20.986401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:20.986682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:20.986978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:20.995656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:20.997419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:21.006989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 572/1142] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:21.012818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:21.023262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f1961-a836-46a6-ac78-72c12f91982b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:21.029072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:21.029921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:21.030192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:21.030456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] PATH_INFO: `/v3/projects/c752be7f7937415e88c05d6d83947ff4` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:21.031790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] RBAC: Authorizing `identity:get_project(project_id=c752be7f7937415e88c05d6d83947ff4)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:21.033819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9fb9-86b6-49b9-914e-d31ca22fd9be admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:21.035482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 571/1143] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:21 2022] GET /identity/v3/projects/c752be7f7937415e88c05d6d83947ff4 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:21.041545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:21.050911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270c2a-d0d7-4a2c-a0b7-c378d57c0fbd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:21.056778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:21.057417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:21.057693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:21.058066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:21.058965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=c752be7f7937415e88c05d6d83947ff4, user.id=a17e89df91954f349b4e760a080cdbdf) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:21.059273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:21.061104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d69f1-b088-4ceb-a941-0fc6be26cde2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:21.066931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 573/1144] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:21 2022] GET /identity/v3/role_assignments?user.id=a17e89df91954f349b4e760a080cdbdf&scope.project.id=c752be7f7937415e88c05d6d83947ff4&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:23.237053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45277d5-706c-4c42-81d2-dd74834e196b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.237661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45277d5-706c-4c42-81d2-dd74834e196b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.237661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45277d5-706c-4c42-81d2-dd74834e196b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.239386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 572/1145] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:23.245046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.245494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.245603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.263991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:23.265158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:23.273369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 574/1146] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:26:23.296938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45277d5-706c-4c42-81d2-dd74834e196b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:23.311182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45277d5-706c-4c42-81d2-dd74834e196b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:23.316320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:23.317115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.317394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.317662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.328460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:23.335423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:23.336573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 573/1147] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:23.343211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:23.352624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40dcb2-04b1-4f50-bae8-a0a5a0fe5ea9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:23.357533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:23.358192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.358466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.358772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.359533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:23.359840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:23.361424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:23.370191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 575/1148] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:23.376593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:23.387189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd81d-e753-4503-9821-45c708f5f18a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:23.392169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:23.393018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.393288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.393553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] PATH_INFO: `/v3/users/a17e89df91954f349b4e760a080cdbdf` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.394839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] RBAC: Authorizing `identity:get_user(user_id=a17e89df91954f349b4e760a080cdbdf)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:23.396955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:23.398517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 574/1149] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:23 2022] GET /identity/v3/users/a17e89df91954f349b4e760a080cdbdf => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:23.405662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:23.419636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622706d8-9658-4b9c-8d31-98503e4311d7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:23.427184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:23.428173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.428450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.428717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] PATH_INFO: `/v3/projects/c752be7f7937415e88c05d6d83947ff4` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.429984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] RBAC: Authorizing `identity:get_project(project_id=c752be7f7937415e88c05d6d83947ff4)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:23.432293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281837-e6c4-4269-8ef2-663ceb9dfa76 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:23.434066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 576/1150] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:23 2022] GET /identity/v3/projects/c752be7f7937415e88c05d6d83947ff4 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:23.440508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:23.450710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cba1d-b861-4e0a-828a-f735da7058fd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:23.455472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:23.456432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:23.456726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:23.456972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] PATH_INFO: `/v3/projects/c752be7f7937415e88c05d6d83947ff4/users/a17e89df91954f349b4e760a080cdbdf/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:23.459148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c752be7f7937415e88c05d6d83947ff4, user_id=a17e89df91954f349b4e760a080cdbdf, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:23.461770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993b39-90f9-45f4-acb5-d9d9919b7a34 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:23.476906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 575/1151] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:26:23 2022] PUT /identity/v3/projects/c752be7f7937415e88c05d6d83947ff4/users/a17e89df91954f349b4e760a080cdbdf/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:26:25.654619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a88a-c072-4f90-9d33-b79b21ad0400 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.655210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a88a-c072-4f90-9d33-b79b21ad0400 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.655210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a88a-c072-4f90-9d33-b79b21ad0400 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.656986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 577/1152] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:25.662552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.663027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.663113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.682126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:25.683476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:25.746555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 576/1153] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:25.770465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a88a-c072-4f90-9d33-b79b21ad0400 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.783604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a88a-c072-4f90-9d33-b79b21ad0400 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.788361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.789141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.789411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.789681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.800305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:25.807140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:25.808345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 578/1154] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:25.814572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.824118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7add6ea-3c19-4a28-812a-7ddc59ed1bac None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.829670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.830333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.830611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.830915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.831683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:25.831983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:25.833589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:25.842358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 577/1155] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:25.848064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.858457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9ce4-47e5-462c-acf4-fc0f608bbf57 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.863393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.864238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.864512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.864779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] PATH_INFO: `/v3/users/a17e89df91954f349b4e760a080cdbdf` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.866007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] RBAC: Authorizing `identity:get_user(user_id=a17e89df91954f349b4e760a080cdbdf)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:25.868138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:25.869681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 579/1156] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/users/a17e89df91954f349b4e760a080cdbdf => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:25.875139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.885543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdba43-bc4a-4e06-b69d-0ae520b096d8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.891047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.891675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.891959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.892228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.900556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:25.902300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:25.911621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 578/1157] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:25.917228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.927189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d8c2-2a7a-4ac2-8f7d-75a688c90282 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.933020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.933857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.934125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.934385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] PATH_INFO: `/v3/projects/c752be7f7937415e88c05d6d83947ff4` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.935730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] RBAC: Authorizing `identity:get_project(project_id=c752be7f7937415e88c05d6d83947ff4)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:25.937741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37caa85-e75b-4457-995c-d815b5e27f28 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:25.939388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 580/1158] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/projects/c752be7f7937415e88c05d6d83947ff4 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:25.945139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:25.954294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eff58-cbd6-47bf-8813-e752df8b28e6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:25.960169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:25.960802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:25.961079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:25.961341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:25.962179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=c752be7f7937415e88c05d6d83947ff4, user.id=a17e89df91954f349b4e760a080cdbdf) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:25.962482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:25.964343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a673-a106-4236-96f5-4e98c47e2d9d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:25.970318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 579/1159] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:25 2022] GET /identity/v3/role_assignments?user.id=a17e89df91954f349b4e760a080cdbdf&scope.project.id=c752be7f7937415e88c05d6d83947ff4&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:28.198606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1faa-6bd4-4a09-9f6b-4978be931e3b None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:28.199196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1faa-6bd4-4a09-9f6b-4978be931e3b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:28.199196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1faa-6bd4-4a09-9f6b-4978be931e3b None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:28.201001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 581/1160] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:28.206526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:28.207000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:28.207091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:28.225125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:28.226314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:28.234830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 580/1161] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:28.258192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a1faa-6bd4-4a09-9f6b-4978be931e3b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:28.272507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a1faa-6bd4-4a09-9f6b-4978be931e3b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:28.277753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:28.278396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:28.278702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:28.278976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:28.287021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:28.288787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:28.297766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 582/1162] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:28.303738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:28.315290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661067d-c56f-4d6c-a9b4-044b527ec9b3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:28.323991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:28.324816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:28.325099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:28.325364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:28.332948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:28.334845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:28.349926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-7ea34aa6-5362-4966-8edf-31664252f75e admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 10 03:26:28.351148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 581/1163] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:26:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:28.357628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:28.366881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab51b-f745-46a3-8495-cdb759aaf614 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:28.372549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:28.373201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:28.373480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:28.373744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:28.374473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:28.374804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:28.376767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714c6a-242a-4e19-b3c9-93c3a7729465 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:28.384581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 583/1164] 10.222.0.32 () {56 vars in 1136 bytes} [Thu Feb 10 03:26:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:30.588056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285e19-985c-4227-9093-f10a68b6df4c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:30.588653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285e19-985c-4227-9093-f10a68b6df4c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:30.588653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285e19-985c-4227-9093-f10a68b6df4c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:30.590492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 582/1165] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:30.596022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308127-2b94-45a4-a167-68e6fa184dd1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:30.596442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308127-2b94-45a4-a167-68e6fa184dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:30.596573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308127-2b94-45a4-a167-68e6fa184dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:30.615634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7b308127-2b94-45a4-a167-68e6fa184dd1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:30.616936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7b308127-2b94-45a4-a167-68e6fa184dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:30.625968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 584/1166] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:30.649330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3285e19-985c-4227-9093-f10a68b6df4c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:30.663369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3285e19-985c-4227-9093-f10a68b6df4c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:30.668772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:30.669420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:30.669692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:30.669953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:30.670706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:30.671702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:26:30.671702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:26:30.671702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:26:30.672570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47430e1-7733-430d-bd47-f878436680a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:30.688549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 583/1167] 10.222.0.32 () {60 vars in 1159 bytes} [Thu Feb 10 03:26:30 2022] POST /identity/v3/domains => generated 267 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:26:32.930277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260870aa-7868-4edf-90e2-c875260b54ed None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:32.930855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260870aa-7868-4edf-90e2-c875260b54ed None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:32.930855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260870aa-7868-4edf-90e2-c875260b54ed None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:32.932600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 585/1168] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:32.938125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:32.938600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:32.938728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:32.958046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:32.959293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:33.021596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 584/1169] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:33.045646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260870aa-7868-4edf-90e2-c875260b54ed None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:33.059352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260870aa-7868-4edf-90e2-c875260b54ed None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:33.064587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:33.065447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:33.065723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:33.065991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] PATH_INFO: `/v3/domains/de46ed352aad439086ad51f725282521` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:33.077558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=de46ed352aad439086ad51f725282521)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:33.079576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2474-68a1-4ed3-8b30-59c5993f3c48 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:33.081166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 586/1170] 10.222.0.32 () {56 vars in 1204 bytes} [Thu Feb 10 03:26:33 2022] GET /identity/v3/domains/de46ed352aad439086ad51f725282521 => generated 267 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:33.087036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:33.096200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07f9a-72f4-4bdc-80cc-039f3972dac3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:33.101335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:33.101985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:33.102260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:33.102520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:33.103272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:33.105152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f59e99-198e-4701-a7eb-8c00480e4adc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:33.132416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 585/1171] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:26:33 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:26:35.364123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d835d2-f831-482c-ba2a-43da1e158038 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:35.364690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d835d2-f831-482c-ba2a-43da1e158038 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:35.364690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d835d2-f831-482c-ba2a-43da1e158038 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:35.366449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 587/1172] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:35.372037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:35.372462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:35.372578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:35.391983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:35.393188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:35.452483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 586/1173] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:35.479398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d835d2-f831-482c-ba2a-43da1e158038 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:35.492617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d835d2-f831-482c-ba2a-43da1e158038 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:35.497481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:35.498345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:35.498631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:35.498957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] PATH_INFO: `/v3/domains/de46ed352aad439086ad51f725282521` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:35.500161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=de46ed352aad439086ad51f725282521)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:35.502482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cbaa1-9642-44da-b20e-5dba800075e9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:35.504098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 588/1174] 10.222.0.32 () {56 vars in 1204 bytes} [Thu Feb 10 03:26:35 2022] GET /identity/v3/domains/de46ed352aad439086ad51f725282521 => generated 267 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:35.509831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:35.519291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c80251-7e4c-4c2a-b112-198fb1d93ee9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:35.525234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:35.525894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:35.526276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:35.526536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:35.527294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:35.529191 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05be31c-6721-4480-b149-6c16fc4a5817 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:35.551606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 587/1175] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:26:35 2022] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:26:37.769582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320e1d-5d6d-4a81-af54-400528bf3804 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.770196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320e1d-5d6d-4a81-af54-400528bf3804 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.770196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320e1d-5d6d-4a81-af54-400528bf3804 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.771907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 589/1176] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:37.777759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.778227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.778316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.796985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:37.798173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:37.807289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 588/1177] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:37.831116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320e1d-5d6d-4a81-af54-400528bf3804 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:37.845301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320e1d-5d6d-4a81-af54-400528bf3804 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:37.850533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:37.851356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.851631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.851902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.863177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:37.870036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:37.871231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 590/1178] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:37.877702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:37.887040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64d8d-d0da-4c04-aaf9-18dc6990ca7c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:37.892870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:37.893544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.893814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.894076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.894876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:37.895174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:37.896772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:37.905891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 589/1179] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:37.911960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:37.922432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b472-8abd-4769-af04-66c7794f8135 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:37.928400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:37.929221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.929500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.929773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] PATH_INFO: `/v3/users/a2af0d1a6cda431caa456140c8d9167e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.944270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2af0d1a6cda431caa456140c8d9167e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:37.946460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:37.948233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 591/1180] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:37 2022] GET /identity/v3/users/a2af0d1a6cda431caa456140c8d9167e => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:37.953956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:37.963926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b824-62e5-4162-817a-9926b6327daa admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:37.968940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:37.969572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:37.969854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:37.970129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:37.978053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:37.979861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:37.988649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 590/1181] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:37.994331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:38.004998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210753b-a810-422a-9eb3-e84d4427be65 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:38.010915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:38.011809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:38.012068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:38.012334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] PATH_INFO: `/v3/projects/ae7af1592f2841839fed2403cd27aa6f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:38.013637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae7af1592f2841839fed2403cd27aa6f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:38.015701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3adb1-0fa0-4f8c-a717-c951ec81e164 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:38.017325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 592/1182] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:37 2022] GET /identity/v3/projects/ae7af1592f2841839fed2403cd27aa6f => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:38.023049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:38.031868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d893bff-7069-463c-a0cd-2c56a0de5fb0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:38.036811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:38.037436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:38.037717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:38.037988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:38.038846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=ae7af1592f2841839fed2403cd27aa6f, user.id=a2af0d1a6cda431caa456140c8d9167e) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:38.039153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:38.040980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432570-20dd-4bcb-a5b3-0dc25bca495b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:38.047515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 591/1183] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:38 2022] GET /identity/v3/role_assignments?user.id=a2af0d1a6cda431caa456140c8d9167e&scope.project.id=ae7af1592f2841839fed2403cd27aa6f&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:40.235512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee98e-46c0-4c42-bb4b-9f12233dc3ad None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.236109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee98e-46c0-4c42-bb4b-9f12233dc3ad None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.236109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee98e-46c0-4c42-bb4b-9f12233dc3ad None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.237835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 593/1184] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:40.243182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.243642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.243735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.263128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:40.264282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:40.272646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 592/1185] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:40.295769 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eee98e-46c0-4c42-bb4b-9f12233dc3ad None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:40.310449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eee98e-46c0-4c42-bb4b-9f12233dc3ad None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:40.315681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:40.316492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.316777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.317053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.329731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:40.336764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:40.337977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 594/1186] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:40.344463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:40.354620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bcf8d-0940-4559-8e64-b4a819d9ec1c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:40.359600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:40.360271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.360545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.360812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.361578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:40.361879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:40.363522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:40.371958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 593/1187] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:40.378849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:40.390102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ac3a-3fdf-41e5-8f63-33a62585490d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:40.395913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:40.396788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.397092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.397336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] PATH_INFO: `/v3/users/a2af0d1a6cda431caa456140c8d9167e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.398693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2af0d1a6cda431caa456140c8d9167e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:40.400832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:40.402474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 595/1188] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:40 2022] GET /identity/v3/users/a2af0d1a6cda431caa456140c8d9167e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:40.408513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:40.418642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90874afa-c889-4c35-95f9-d70a4d760137 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:40.423614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:40.424467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.424741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.425010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] PATH_INFO: `/v3/projects/ae7af1592f2841839fed2403cd27aa6f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.426267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] RBAC: Authorizing `identity:get_project(project_id=ae7af1592f2841839fed2403cd27aa6f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:40.428382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f82e7b-0cfc-45e5-9441-9ac856f3394a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:40.430033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 594/1189] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:40 2022] GET /identity/v3/projects/ae7af1592f2841839fed2403cd27aa6f => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:26:40.436463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:40.448630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8e7c-4722-4384-b6c8-0af98d537197 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:40.453393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:40.454284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:40.454576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:40.454890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] PATH_INFO: `/v3/projects/ae7af1592f2841839fed2403cd27aa6f/users/a2af0d1a6cda431caa456140c8d9167e/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:40.456910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7af1592f2841839fed2403cd27aa6f, user_id=a2af0d1a6cda431caa456140c8d9167e, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:40.459620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8553-3fe3-4637-9651-2445d25ef2d1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:40.474243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 596/1190] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:26:40 2022] PUT /identity/v3/projects/ae7af1592f2841839fed2403cd27aa6f/users/a2af0d1a6cda431caa456140c8d9167e/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:26:42.680243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5d1e8-cbee-4615-b09a-de56e25fa774 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.680763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5d1e8-cbee-4615-b09a-de56e25fa774 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.680763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5d1e8-cbee-4615-b09a-de56e25fa774 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.682587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 595/1191] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:26:42.688451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.688933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.689033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.708168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:26:42.709351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:26:42.774681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 597/1192] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:26:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:26:42.799407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5d1e8-cbee-4615-b09a-de56e25fa774 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:42.813273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5d1e8-cbee-4615-b09a-de56e25fa774 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:42.818367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:42.819213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.819492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.819743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.830875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:26:42.838029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:26:42.839456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 596/1193] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:26:42.845918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:42.855266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41ffb1-ae25-4ced-b2c8-9d6dbfddf70a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:42.860426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:42.861446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.861900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.862194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.862995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:42.863305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:42.864924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:42.874152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 598/1194] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:42.880673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:42.892010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fdb4d-3066-464f-a031-d1acfa495a66 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:42.897069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:42.898061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.898336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.898606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] PATH_INFO: `/v3/users/a2af0d1a6cda431caa456140c8d9167e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.899880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2af0d1a6cda431caa456140c8d9167e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:42.902179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:42.903822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 597/1195] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/users/a2af0d1a6cda431caa456140c8d9167e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:42.909793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:42.919855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5f05-9a93-4ee2-90a9-a0c1a1a8dd67 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:42.924711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:42.925305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.925587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.925862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.935018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:42.937179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:42.949251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 599/1196] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:26:42.962033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:42.972587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dac0a5-27cb-4251-89e1-2ff44c979101 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:42.977992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:42.978895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:42.979389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:42.979688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] PATH_INFO: `/v3/projects/ae7af1592f2841839fed2403cd27aa6f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:42.980990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] RBAC: Authorizing `identity:get_project(project_id=ae7af1592f2841839fed2403cd27aa6f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:42.983124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998982e-7871-40ec-8402-6c1f73b40c2c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:42.984814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 598/1197] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/projects/ae7af1592f2841839fed2403cd27aa6f => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:26:42.991181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:26:43.001909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7697f-3166-4237-bab6-022bce8105ae admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:26:43.007267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:26:43.007993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:26:43.008294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:26:43.008569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:26:43.009488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=ae7af1592f2841839fed2403cd27aa6f, user.id=a2af0d1a6cda431caa456140c8d9167e) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:26:43.009831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:26:43.012008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc4cc5-9155-418c-9bb9-02cb832c3370 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:26:43.019219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 600/1198] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:26:42 2022] GET /identity/v3/role_assignments?user.id=a2af0d1a6cda431caa456140c8d9167e&scope.project.id=ae7af1592f2841839fed2403cd27aa6f&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:45.537253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108d57-c335-4abc-bcf4-1a4e0ee5f965 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:45.537873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108d57-c335-4abc-bcf4-1a4e0ee5f965 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:45.537873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108d57-c335-4abc-bcf4-1a4e0ee5f965 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:45.540618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 599/1199] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:27:45.547358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:45.548056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:45.548190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:45.575205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:27:45.576814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:27:45.588166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 601/1200] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:27:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:27:45.619154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9108d57-c335-4abc-bcf4-1a4e0ee5f965 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:45.633964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9108d57-c335-4abc-bcf4-1a4e0ee5f965 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:45.638977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:45.639790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:45.640113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:45.640456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:45.656620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:45.659445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:45.686181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:45.687200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 600/1201] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:45.704664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:45.720861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452cdba-d51e-462d-896c-f2aabb8687d7 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:45.729078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:45.730159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:45.730767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:45.731181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:45.732448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:45.732962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:45.734886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d413-0676-4349-9aed-aa85a7dc999e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:45.764589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 602/1202] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:45.767751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:45.785501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a9c2-539d-4452-b0e2-1b3844ce3f52 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:45.793786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:45.795342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:45.796294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:45.797107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:45.798217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:45.801665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac349d-df74-40cc-8e8b-3954e1a1d542 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:45.831780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 601/1203] 10.222.0.32 () {60 vars in 1153 bytes} [Thu Feb 10 03:27:45 2022] POST /identity/v3/users => generated 251 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:27:48.508786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbde7-a8a1-4b26-b875-4132fa173fc8 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.509627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbde7-a8a1-4b26-b875-4132fa173fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.509627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbde7-a8a1-4b26-b875-4132fa173fc8 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.511405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 603/1204] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:27:48.517712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.518571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.518571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.539581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:27:48.540817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:27:48.549980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 602/1205] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:27:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:27:48.579977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fbde7-a8a1-4b26-b875-4132fa173fc8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.601995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fbde7-a8a1-4b26-b875-4132fa173fc8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.608885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.609796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.610097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.610512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.626222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:27:48.634185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:27:48.635505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 604/1206] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:48.642228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.653784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bec34-cbfa-4ee6-aa10-d84a7cecd221 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.669680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.670911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.671373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.671831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.673095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:48.673680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.676471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.689403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 603/1207] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:48.697090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.711745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bcb6f-6622-48c7-9d7a-f70166520b59 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.719425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.720310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.720803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.721065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.736380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.738191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.759701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:48.760891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 605/1208] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:48.767799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.780643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4846-ba88-4625-a28a-9db52b87f9cb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.788475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.789236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.789521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.789790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.790812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:48.791142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.793379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.808902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 604/1209] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:48.814571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.827307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9689604-8aa4-4c39-83a4-548de95e5bb3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.833888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.835046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.835531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.836152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.847915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.850274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.867708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:27:48.874012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 606/1210] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:48.875580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.888670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9085b-cea1-4e97-920a-de09096d0110 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.895739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.896625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.896911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.897180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.898178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:48.898534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.900678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.922115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 605/1211] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:48.928946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:48.943561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0cf9-947a-497a-9e32-2ff3f7f838da admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:48.949523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:48.950360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:48.950743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:48.951117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:48.962557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:48.969088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:48.983500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 607/1212] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:27:48.989973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:49.002015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe99d8-34c7-41c2-a3db-969cbd4aa6cb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:49.008144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:49.009532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:49.010065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:49.010452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:49.026351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:49.028932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:49.051215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:49.058694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 606/1213] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:49.066689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:49.078896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8477a-57f2-4288-9043-75af6a6646fb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:49.086568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:49.087454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:49.087944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:49.088363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:49.089359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:49.089774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:49.092865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:49.115308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 608/1214] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:49.121377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:49.136199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646a812-bb3d-4534-9d64-b0bc7c3d5759 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:49.142583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:49.143598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:49.143964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:49.144181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:49.153928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:49.155839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:49.172058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:27:49.173493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 607/1215] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:49.180659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:49.195115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b841-c200-4c13-b425-a9aa5d96ece3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:49.201370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:49.202164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:49.202591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:49.203035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:49.203692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:49.204049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:49.206239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16997543-5ea2-4da3-b932-1bdb76da9936 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:49.227978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 609/1216] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:27:49.236010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:49.247803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b7aaf-0313-4564-8dc3-371fb2c6d19b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:49.253724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:49.254491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:49.255080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:49.255446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:49.256401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b3d2d4a5e36d4d39909faf4bf065f3e6) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:49.256815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:49.259047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa27de1-2030-4460-b10e-f7d8118317a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:49.266568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 608/1217] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:27:49 2022] GET /identity/v3/role_assignments?user.id=b3d2d4a5e36d4d39909faf4bf065f3e6&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:27:51.759280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198329-69fc-4551-b93b-4648eb1399b8 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:51.760083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198329-69fc-4551-b93b-4648eb1399b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:51.760083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198329-69fc-4551-b93b-4648eb1399b8 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:51.761950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 610/1218] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:27:51.769076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:51.769610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:51.769610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:51.789295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:27:51.790871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:27:51.803057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 609/1219] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:27:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:27:51.829449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b198329-69fc-4551-b93b-4648eb1399b8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:51.845509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b198329-69fc-4551-b93b-4648eb1399b8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:51.853701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:51.855116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:51.855405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:51.855732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:51.870001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:27:51.878889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:27:51.880714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 611/1220] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:51.887984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:51.898994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23820296-8bc1-4969-8dfc-d04aae018b4e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:51.905476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:51.906276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:51.906590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:51.906927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:51.907736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:51.908108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:51.910325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:51.926377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 610/1221] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:51.928743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:51.942194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0fc5-54e6-477d-9907-77573444cfce admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:51.948496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:51.949578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:51.949865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:51.950153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:51.963766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:51.965087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:51.991121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:51.992625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 612/1222] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:51.999896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.012709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d832-c24d-4c31-bd1c-c46596897ec2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.018081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.018798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.019080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.019409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.020174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:52.020573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.022376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.038722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 611/1223] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:52.045229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.057295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62f3a-12df-47df-8e69-355bb4d2ebeb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.062954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.063943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.064303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.064658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.074198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.077131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.098627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:27:52.100378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 613/1224] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:52.108153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.122126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a0e07-77f3-48bd-86f3-8fdf87b2b3b1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.128722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.129476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.129834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.130073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.131101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:52.131454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.135933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.156859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 612/1225] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:52.162795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.174423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b981-9650-45b4-9201-6cedbf6a9cc0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.180116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.181000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.181402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.181752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.194522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.196792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.216195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:52.217587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 614/1226] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:52.223785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.236806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5645cb-976f-4c55-b9aa-efd82c213065 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.241571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.242287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.242614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.242907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.243681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:52.243978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.245606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.263416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 613/1227] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:52.265110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.277486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acc37-c400-4ab5-a71b-f458aa4eefcd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.283470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.284755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.285368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.285851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.295809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.298971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.318770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:27:52.320389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 615/1228] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:52.329967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.345284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ac1c-af1d-4d03-8aff-aa82c19d7ac9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.353559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.354707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.355197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.355655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.357154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:52.357696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.361272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb671636-8de6-425b-8b63-3e252292d2b2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.386431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 614/1229] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:52.389330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:52.402705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718b165-129f-4302-8659-b44eba120a89 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:52.408221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:52.409252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:52.409606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:52.409899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b3d2d4a5e36d4d39909faf4bf065f3e6/roles/57f4135f4a0344078fdf015ea38df933` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:52.431416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=b3d2d4a5e36d4d39909faf4bf065f3e6, role_id=57f4135f4a0344078fdf015ea38df933)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:52.434395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3a6b-7af1-4dbb-b0f4-f46cdce22df9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:52.451005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 616/1230] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:27:52 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b3d2d4a5e36d4d39909faf4bf065f3e6/roles/57f4135f4a0344078fdf015ea38df933 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:27:54.939442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ef7f-4f10-4f7d-b85e-e79130665ed0 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:54.940000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ef7f-4f10-4f7d-b85e-e79130665ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:54.940102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28ef7f-4f10-4f7d-b85e-e79130665ed0 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:54.941892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 615/1231] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:27:54.947464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:54.947958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:54.948063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:54.969271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:27:54.970778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:27:55.053072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 617/1232] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:27:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:27:55.080981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28ef7f-4f10-4f7d-b85e-e79130665ed0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.095653 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28ef7f-4f10-4f7d-b85e-e79130665ed0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.101748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.102754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.103225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.103464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.122332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:27:55.134207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 10 03:27:55.135923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 616/1233] 10.222.0.32 () {56 vars in 1123 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:55.143153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.152918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1eb8c4-b975-4ad3-a4ff-377cfa131cb6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.158516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.159324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.159643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.159875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.160701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.161079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.162813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.175825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 618/1234] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:55.183615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.196067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac1b8-cfb8-414e-8203-756eda5a3838 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.201431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.202383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.202695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.202978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.217592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.217592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.238487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:55.239760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 617/1235] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:55.246752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.258345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf8fc-8aa0-404a-b922-6923fbe8e503 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.263512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.264180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.264461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.264733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.265491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.265797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.267438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.280903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 619/1236] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:27:55.288211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.300379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42628c-211a-4d51-bddc-9831ab1a367f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.305934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.307296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.307852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.308115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.319871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.322394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.340806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:27:55.342075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 618/1237] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:55.349152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.361690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f6266-f992-40e7-a968-d9c3129bf13f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.367951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.368969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.369282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.369714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.370940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.371267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.373467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.397314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 620/1238] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:55.404086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.415947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32879f-6b62-4113-b8e2-5b0307a15b85 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.421303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.421995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.422280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.422549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.434780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.436713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.450349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 619/1239] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:27:55.456318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.467324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece35e-7328-4a62-b0df-b50e9b05a533 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.472744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.473663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.473958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.474221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.486345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.488616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.507415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:55.508694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 621/1240] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:55.516194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.533528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1ce4f-0ac4-4986-ac83-df2dfccf19c3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.540351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.541194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.541625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.542132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.543496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.544011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.546870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.573646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 620/1241] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:55.575061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.586694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500a7a-0503-4b9f-a47b-6c39fb5e2d80 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.593574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.594782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.595206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.595494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.604038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.606337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.622915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:27:55.624218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 622/1242] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:55.631607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.646785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7b4e-f9d3-4760-b577-153ea1e896f6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.653509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.654239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.654549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.654881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.655760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.656069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.658065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414c2f-222e-45d0-b181-b8e6aeedaf32 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.675453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 621/1243] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:27:55.683976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:55.696251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ce29-ac34-46c3-b9fd-0728275d58e0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:55.701477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:55.702119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:55.702393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:55.702703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:55.703548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] RBAC: Adding query filter params (role.id=57f4135f4a0344078fdf015ea38df933, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b3d2d4a5e36d4d39909faf4bf065f3e6) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:55.703855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:55.705719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa802d-402d-4c8d-8c36-e35274b63d5d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:55.712549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 623/1244] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:27:55 2022] GET /identity/v3/role_assignments?user.id=b3d2d4a5e36d4d39909faf4bf065f3e6&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=57f4135f4a0344078fdf015ea38df933 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:58.207273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad7a-f38c-4e53-a877-105ebfe4f6ce None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.207836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad7a-f38c-4e53-a877-105ebfe4f6ce None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.208053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad7a-f38c-4e53-a877-105ebfe4f6ce None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.210158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 622/1245] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:27:58.216516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.217208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.217208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.242327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:27:58.244012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:27:58.255335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 624/1246] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:27:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:27:58.282606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ad7a-f38c-4e53-a877-105ebfe4f6ce None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.297129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ad7a-f38c-4e53-a877-105ebfe4f6ce None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.302236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.303156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.303428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.303693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.317473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:27:58.330876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:27:58.333459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 623/1247] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:58.342198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.355919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d095-6a67-42e0-9f06-cdf7910bae2a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.362132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.362861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.363148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.363427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.364276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.364582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.366511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.377403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 625/1248] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:58.384732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.395767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04db5f-bb56-4171-9e27-4ce749dd28e0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.401103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.402089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.402370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.402726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.415229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.417212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.435949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:58.437405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 624/1249] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:27:58.443946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.454172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e91d7f-a66e-434c-8d44-f88d5935c557 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.459084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.459696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.459979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.460256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.461066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.461371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.463011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.482735 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 626/1250] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:58.488677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.500130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f145772-404d-4979-82e6-d3485a8c3405 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.505422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.506239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.506515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.506814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.515797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.517944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.533914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:27:58.535246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 625/1251] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:58.541763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.552636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba30f7-e5e2-4c22-9bb3-454f86cfe79b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.557943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.558821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.559192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.559738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.561083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.561441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.563727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.597178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 627/1252] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:58.598919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.615719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc970f-5c2a-485a-a850-d221f70f7c62 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.621815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.622474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.622783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.623058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.633132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.635184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.646255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 626/1253] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:27:58.653127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.667306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f561b5-8107-4d0f-b7a2-c5f5d1196589 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.672128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.672945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.673211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.673478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.685107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.686796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.708067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:27:58.709477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 628/1254] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:58.717385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.730000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38274d-aa68-4ffb-9101-2979a7bbac7b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.735985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.736908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.737188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.737599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.738423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.738837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.740545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.760043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 627/1255] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:27:58.766677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.778233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee998e6-1e28-4ff8-a596-568fcff672de admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.783995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.784922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.785299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.785587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.794831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.796971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.812387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:27:58.814165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 629/1256] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:27:58.821858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.836769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3a06-d080-4c0e-8220-108a6e6f0c38 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.842180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.842995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.843347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.843678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.844626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.845095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.848362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87e8c6-ced1-4403-9cf1-b82513774886 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.864835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 628/1257] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:27:58.871283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:27:58.883362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d139ec-dc7e-4cbe-aa2b-30464a2b0df8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:27:58.889028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:27:58.889748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:27:58.890024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:27:58.890285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:27:58.891219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b3d2d4a5e36d4d39909faf4bf065f3e6) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:27:58.891524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:27:58.893466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09285a2-7792-474e-b5e3-45c253060096 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:27:58.900182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 630/1258] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:27:58 2022] GET /identity/v3/role_assignments?user.id=b3d2d4a5e36d4d39909faf4bf065f3e6&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.244041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376f4-9e6d-4137-81b5-6b7eb42a1ba3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.244698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376f4-9e6d-4137-81b5-6b7eb42a1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.244698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1376f4-9e6d-4137-81b5-6b7eb42a1ba3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.247037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 629/1259] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:28:01.254252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.254845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.255419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.277853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:01.279563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:01.290893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 631/1260] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:28:01.318593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1376f4-9e6d-4137-81b5-6b7eb42a1ba3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.333038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1376f4-9e6d-4137-81b5-6b7eb42a1ba3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.338565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.339657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.339963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.340237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.353114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:28:01.364309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:28:01.365625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 630/1261] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:01.373026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.383566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8daa9b-3f5a-4efb-a4de-0de2d8e5461e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.388607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.389373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.389728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.390080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.390953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:01.391330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.394366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.403588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 632/1262] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.409989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.423170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60aaa-7e41-43df-a701-5b8f83dab48c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.428864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.429729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.430136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.430407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.443618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.445964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.466197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:28:01.467775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 631/1263] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:01.473995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.489568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25481a2-8d68-4e39-8298-75c2dbb5d038 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.495280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.496205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.496681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.497101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.498220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:01.498551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.501256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.517580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 633/1264] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.525951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.537820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db8ebe-1885-4968-bccc-2c78871d4966 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.543115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.543989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.544340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.544633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.555275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.555894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.577362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:28:01.579312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 632/1265] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:01.586546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.602031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80154f4-f4ec-4e7c-9dc5-cb7bfccad979 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.608831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.609920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.610482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.610931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.611962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:01.612333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.614196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.637485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 634/1266] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.643991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.655888 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d145-486d-4034-8449-933af878bf36 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.664268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.665195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.665468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.665741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.687643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.690161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.712677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:28:01.713981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 633/1267] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:01.720575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.731777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea61b4-d749-4dc8-9ef3-1b22c345c1bf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.737597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.738426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.738761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.739071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.739899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:01.740291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.742742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.757021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 635/1268] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.763404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.775725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223cdd8-e9e7-4328-a262-5909fd330a77 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.782494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.783513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.783855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.784199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.794643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.797661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.815208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:28:01.816451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 634/1269] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:28:01.824771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.838136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c5c6-e7bc-4032-b81d-144b04c833cb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.844547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.845600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.846107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.846562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.847530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:01.847903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.850797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e1c75-1d85-472e-97b8-c14f04b580b1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.864556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 636/1270] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:01.872005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:01.884507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c56f-70d4-496f-916a-43e6351e2bac admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:01.890709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:01.891710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:01.891978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:01.892249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] PATH_INFO: `/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b3d2d4a5e36d4d39909faf4bf065f3e6/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:01.894327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bead2b0a002b4d28b6aeb573040adb08, user_id=b3d2d4a5e36d4d39909faf4bf065f3e6, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:01.897008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca018c-36ea-481c-be12-cb48250e546e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:01.914713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 635/1271] 10.222.0.32 () {58 vars in 1460 bytes} [Thu Feb 10 03:28:01 2022] PUT /identity/v3/projects/bead2b0a002b4d28b6aeb573040adb08/users/b3d2d4a5e36d4d39909faf4bf065f3e6/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:28:04.468495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702712-13b2-4d4d-bdb3-2a4c43572f19 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.469108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702712-13b2-4d4d-bdb3-2a4c43572f19 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.469108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702712-13b2-4d4d-bdb3-2a4c43572f19 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.472290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 637/1272] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:28:04.481124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.481861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.481861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.511303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:04.512605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:04.595990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 636/1273] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:28:04.623724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702712-13b2-4d4d-bdb3-2a4c43572f19 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.639077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702712-13b2-4d4d-bdb3-2a4c43572f19 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.644347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.645277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.645549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.645825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.659510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 10 03:28:04.667326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 10 03:28:04.669158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 638/1274] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:04.675862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.687300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c79cd-5acf-4f47-9218-de28f921dfdc None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.692815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.693512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.693787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.694050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.694999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:04.695304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.697301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.708257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 637/1275] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:04.714591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.726173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d94bc-bd50-4fc5-bb87-6bb628ae1b98 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.731640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.732461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.732767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.733106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.745680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.747759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.768012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:28:04.769519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 639/1276] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:04.776079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.788088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714757-db27-4e83-acd4-f1e939b83419 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.793252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.794138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.794424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.794729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.795622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:04.795992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.797839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.817047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 638/1277] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:04.823621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.835136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a912-35f6-44bc-b566-d5fda9704392 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.840274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.841095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.841370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.841640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.850214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.852472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.872263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 10 03:28:04.873533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 640/1278] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:04.881303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.899978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dac768-ff22-4ce1-871e-e1f36aa01e99 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.909951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.910827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.911030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.911286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.912314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:04.912615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.914833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.938400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 639/1279] 10.222.0.32 () {56 vars in 1164 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:04.945135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:04.955927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f1de-6d84-4176-bb44-b46f0b46224b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:04.961545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:04.962264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:04.962562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:04.962892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:04.972862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:04.974809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:04.985962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 641/1280] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:28:04.992502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:05.009449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59934-32e0-4571-bbf8-80940d7b8134 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:05.016391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:05.017208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:05.017485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:05.017786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:05.030315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:05.032255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:05.050470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 10 03:28:05.052045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 640/1281] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Feb 10 03:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 10 03:28:05.057752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:05.067336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c4de-154e-4070-af1e-b0c23042d2b7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:05.072121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:05.072801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:05.073123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:05.073342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:05.074429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:05.074429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:05.076022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:05.093736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 642/1282] 10.222.0.32 () {56 vars in 1130 bytes} [Thu Feb 10 03:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:05.099281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:05.109675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bbde6-858e-4116-b1fa-a82da766b712 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:05.115883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:05.116750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:05.117025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:05.117294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:05.125517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:05.128336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:05.145313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING keystone.server.flask.application [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 10 03:28:05.146723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 641/1283] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Feb 10 03:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:05.154559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:05.165345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebf17-2942-429f-8a5a-c01567c67d3f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:05.170843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:05.171582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:05.171800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:05.172062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:05.172864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:05.173175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:05.175096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ec9d-3a54-4919-b5a8-dbacb1b8343b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:05.188629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 643/1284] 10.222.0.32 () {56 vars in 1169 bytes} [Thu Feb 10 03:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:05.194915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:05.209374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28008-8e89-4a78-9139-28fa3519d05a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:05.218914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:05.219591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:05.219869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:05.220155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:05.221036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] RBAC: Adding query filter params (role.id=e90a5aca8c9c4ad88b3a04e367493007, scope.project.id=bead2b0a002b4d28b6aeb573040adb08, user.id=b3d2d4a5e36d4d39909faf4bf065f3e6) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:05.221357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:05.224759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1027-6336-41aa-b85a-cf1773a196e7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:05.250770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 642/1285] 10.222.0.32 () {56 vars in 1395 bytes} [Thu Feb 10 03:28:05 2022] GET /identity/v3/role_assignments?user.id=b3d2d4a5e36d4d39909faf4bf065f3e6&scope.project.id=bead2b0a002b4d28b6aeb573040adb08&role.id=e90a5aca8c9c4ad88b3a04e367493007 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:07.664396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebff8-8554-4cc0-8326-4f5b42ab9a69 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:07.664917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebff8-8554-4cc0-8326-4f5b42ab9a69 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:07.664917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ebff8-8554-4cc0-8326-4f5b42ab9a69 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:07.666757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 644/1286] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:28:07.672223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:07.672672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:07.672854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:07.691282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:07.692481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:07.700502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 643/1287] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:28:07.723281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ebff8-8554-4cc0-8326-4f5b42ab9a69 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:07.737631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ebff8-8554-4cc0-8326-4f5b42ab9a69 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:07.743070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:07.743861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:07.744139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:07.744414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:07.745083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:07.746769 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:07.758607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 03:28:07.759762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 645/1288] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:28:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:07.765866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:07.775273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f4d1-570f-4276-bb22-a1d1a4aa6f94 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:07.781219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:07.781877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:07.782152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:07.782422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:07.783180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:07.783482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:07.785086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1587f03-9118-4083-ad45-0b0d3b532919 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:07.790183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 644/1289] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Feb 10 03:28:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:07.796163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:07.806160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3d87-615c-4891-b418-ceb74691735c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:07.811235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:07.811892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:07.812167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:07.812445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] PATH_INFO: `/v3/services` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:07.813178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:07.813517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:07.815127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66831e0-7dbd-4504-a1be-29a9ecdd526a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:07.819894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 646/1290] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Feb 10 03:28:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:28:10.006863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbdaf-d050-438c-aeff-87f45f7f6f0a None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:10.007430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbdaf-d050-438c-aeff-87f45f7f6f0a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:10.007430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbdaf-d050-438c-aeff-87f45f7f6f0a None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:10.009111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 645/1291] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:28:10.014469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bcc1-dd1c-4502-ae95-c54854ae090a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:10.014963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bcc1-dd1c-4502-ae95-c54854ae090a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:10.015058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bcc1-dd1c-4502-ae95-c54854ae090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:10.034482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5f09bcc1-dd1c-4502-ae95-c54854ae090a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:10.035710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5f09bcc1-dd1c-4502-ae95-c54854ae090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:10.044870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 647/1292] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:28:10.068504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafbdaf-d050-438c-aeff-87f45f7f6f0a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:10.082560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafbdaf-d050-438c-aeff-87f45f7f6f0a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:10.087680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:10.088326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:10.088598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:10.088866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:10.089601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:10.091230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89e76d-c4ea-4b6d-9753-64f47cc7cae5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:10.107897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 646/1293] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Feb 10 03:28:10 2022] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:28:12.315295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64713-d336-4e3c-850f-b5ac518108b8 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.315859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64713-d336-4e3c-850f-b5ac518108b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.315859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64713-d336-4e3c-850f-b5ac518108b8 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.317635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 648/1294] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:28:12.323571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.324015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.324124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.343241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:12.344408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:12.361830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 647/1295] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:12 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:28:12.387032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64713-d336-4e3c-850f-b5ac518108b8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:12.400752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64713-d336-4e3c-850f-b5ac518108b8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:12.405921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:12.406750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.407030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.407322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.407979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:12.409581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:12.423437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 03:28:12.424573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 649/1296] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:28:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:12.431040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:12.440435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e0cc-928c-4938-bd5f-589efe61b2a1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:12.446223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:12.446910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.447181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.447443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.448147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:12.448446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:12.450035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:12.455578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 648/1297] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Feb 10 03:28:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:12.462352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:12.475016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbc6d-ec8c-4a04-b3ce-7a1fa0ff8e81 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:12.481881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:12.482801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.483087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.483597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.484509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] RBAC: Adding query filter params (interface=public, service_id=ebe9e07d5dd74219b9fec9b08166c5d4, region_id=RegionOne) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:12.484900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:12.487240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ea3e-0389-4371-8e90-037528a14966 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:12.493532 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 650/1298] 10.222.0.32 () {56 vars in 1272 bytes} [Thu Feb 10 03:28:12 2022] GET /identity/v3/endpoints?service_id=ebe9e07d5dd74219b9fec9b08166c5d4&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:12.499759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:12.510236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1b060-1e44-46ff-a4ca-e7254d1e1735 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:12.516052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:12.516703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:12.516986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:12.517255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:12.517952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:12.519594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1322a-7cc9-4356-b119-fd66b138710f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:12.526687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 649/1299] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:28:12 2022] GET /identity/v3/services => generated 2191 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:28:14.778423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c765b3-3873-4c33-9cf4-fcb0ad5fca1d None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:14.779137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c765b3-3873-4c33-9cf4-fcb0ad5fca1d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:14.779137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c765b3-3873-4c33-9cf4-fcb0ad5fca1d None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:14.780745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 651/1300] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:28:14.786336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:14.786809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:14.786910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:14.805101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:28:14.806287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:28:14.814628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 650/1301] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:28:14.838190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c765b3-3873-4c33-9cf4-fcb0ad5fca1d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:14.851028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c765b3-3873-4c33-9cf4-fcb0ad5fca1d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:14.855883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:14.856673 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:14.856949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:14.857226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:14.857894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:14.859523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:14.870778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING keystone.server.flask.application [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 10 03:28:14.871944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 652/1302] 10.222.0.32 () {56 vars in 1138 bytes} [Thu Feb 10 03:28:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 10 03:28:14.878711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:14.888449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518fc8f-cef0-4fe8-ace4-5940333f2e62 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:14.894024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:14.894696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:14.895002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:14.895271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] PATH_INFO: `/v3/services` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:14.895983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:28:14.896287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:14.897918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adccda-5586-4683-bbdc-66faf7459789 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:14.903818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 651/1303] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Feb 10 03:28:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:28:14.909920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:28:14.921147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582748-4dc9-4e3a-966a-6291ccfbb66e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:28:14.927210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:28:14.927906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:28:14.928272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:28:14.928739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:28:14.929564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:28:14.931323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d147a2c-8289-4661-b688-6d2f51b538ab admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:28:14.953896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 653/1304] 10.222.0.32 () {60 vars in 1165 bytes} [Thu Feb 10 03:28:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:29:22.546583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:22.547360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:22.547360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:22.553934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 652/1305] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:22.555449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddda-9264-437b-bd03-7f14d6fe185d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:22.555890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddda-9264-437b-bd03-7f14d6fe185d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:22.555996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddda-9264-437b-bd03-7f14d6fe185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:22.710258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-630fddda-9264-437b-bd03-7f14d6fe185d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:22.711863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-630fddda-9264-437b-bd03-7f14d6fe185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:22.899450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 654/1306] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:22.900820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:22.902621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:23.059036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14f80-c994-4292-90a7-d8969bd42237 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:23.166419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:23.167583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:23.167956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:23.168234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:23.169024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:23.170965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b678be-de41-43fc-9806-14e8017fa595 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:23.194834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 653/1307] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:29:22 2022] GET /identity/v3/projects => generated 2553 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:29:25.494554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1782-45f9-4c56-8ba0-e5c7b7d234d0 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:25.495117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1782-45f9-4c56-8ba0-e5c7b7d234d0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:25.495117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1782-45f9-4c56-8ba0-e5c7b7d234d0 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:25.496994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 655/1308] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:25.503482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b565-9b65-4ba6-bca5-a2328d0119e1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:25.504424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b565-9b65-4ba6-bca5-a2328d0119e1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:25.504696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7b565-9b65-4ba6-bca5-a2328d0119e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:25.592033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-acd7b565-9b65-4ba6-bca5-a2328d0119e1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:25.593262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-acd7b565-9b65-4ba6-bca5-a2328d0119e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:25.740274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 654/1309] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:25.797140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:25.798215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:25.799038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:25.802616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 656/1310] 10.222.0.32 () {54 vars in 964 bytes} [Thu Feb 10 03:29:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:25.810135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2639b-7f7e-4a02-b6b9-44efad8ade9b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:25.810527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2639b-7f7e-4a02-b6b9-44efad8ade9b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:25.810852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2639b-7f7e-4a02-b6b9-44efad8ade9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:25.931948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a7f2639b-7f7e-4a02-b6b9-44efad8ade9b None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:25.933210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a7f2639b-7f7e-4a02-b6b9-44efad8ade9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:26.018050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 655/1311] 10.222.0.32 () {58 vars in 1061 bytes} [Thu Feb 10 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:29:26.028835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:26.031691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:26.254917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7a7e-a1c8-4e27-8c47-4e1e294ddda6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:26.351432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:26.352607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:26.353044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:26.353485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:26.355698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:26.512088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:26.513768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c7e07-196d-4459-ae24-394ac3bf9b50 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:26.539746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 657/1312] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:29.079837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:29.080370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:29.080370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:29.082225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 656/1313] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:29.088088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4846a0-1517-4aeb-994f-847ce3807160 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:29.088552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4846a0-1517-4aeb-994f-847ce3807160 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:29.088640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4846a0-1517-4aeb-994f-847ce3807160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:29.161675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ee4846a0-1517-4aeb-994f-847ce3807160 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:29.163021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ee4846a0-1517-4aeb-994f-847ce3807160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:29.394887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 658/1314] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:29.439768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:29.441307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:29.546625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcbc7b-b341-4ea8-b7ed-63560f117ca3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:29.618946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:29.619603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:29.619880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:29.620150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:29.621790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:29.734231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:29.735713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47221a-4dda-417e-a98d-2714b1f78212 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:29.754514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 657/1315] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:32.272942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:32.273768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:32.273768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:32.275589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 659/1316] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:32.282208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf53aa-e7b4-4bc6-bb0c-95360aaa5166 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:32.282849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf53aa-e7b4-4bc6-bb0c-95360aaa5166 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:32.282849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf53aa-e7b4-4bc6-bb0c-95360aaa5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:32.356109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-efdf53aa-e7b4-4bc6-bb0c-95360aaa5166 None None] MFA Rules not processed for user `5707e260eb2943eebfe40a32c3e5b3da`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:32.357314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-efdf53aa-e7b4-4bc6-bb0c-95360aaa5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:32.459852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 658/1317] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:32.503131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:32.504694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:32.626981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670d6e-a025-49e2-bfe7-4aeb9154f5ee None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:32.710674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:32.711350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:32.711617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:32.711891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:32.713527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:32.821213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:32.822690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8ebe1-f118-4bfe-951a-6fdab74ee5e4 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:32.840700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 660/1318] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:35.576865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:35.577431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:35.577431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:35.579410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 659/1319] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:35.584956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec81-2426-4afa-8e75-ed2e8180defa None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:35.585409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec81-2426-4afa-8e75-ed2e8180defa None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:35.585504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dec81-2426-4afa-8e75-ed2e8180defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:35.653555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3d7dec81-2426-4afa-8e75-ed2e8180defa None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:35.654818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3d7dec81-2426-4afa-8e75-ed2e8180defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:35.753988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 661/1320] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:35.793764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:35.795334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:35.900264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f9d4-a2dd-48cc-91d3-7710491682b2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:35.974470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:35.975154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:35.975436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:35.975692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:35.977331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:36.091130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:36.092882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640022e4-d073-4248-ae91-7e96245e8bfa service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:36.115697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 660/1321] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:39.159171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:39.159965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:39.159965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:39.161613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 662/1322] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:39.168557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b40c4-8bd5-48b7-ad3d-2b48522614f3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:39.169080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b40c4-8bd5-48b7-ad3d-2b48522614f3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:39.169606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b40c4-8bd5-48b7-ad3d-2b48522614f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:39.248342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2e0b40c4-8bd5-48b7-ad3d-2b48522614f3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:39.249480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2e0b40c4-8bd5-48b7-ad3d-2b48522614f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:39.357018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 661/1323] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:39.394139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:39.395712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:39.511055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029ed00-c284-4c8f-9a74-72f27a4381a2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:39.608020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:39.609078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:39.609498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:39.609752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:39.611712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:39.750975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:39.752484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26466c79-05e9-4f51-bd53-c8674f1dba39 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:39.773352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 663/1324] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:42.110037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800610e-7b32-4f6d-8e6c-4529288d7eb1 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:42.110731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800610e-7b32-4f6d-8e6c-4529288d7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:42.110731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800610e-7b32-4f6d-8e6c-4529288d7eb1 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:42.112496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 662/1325] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:42.119281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5133-1438-40bb-9c95-e6d9d399f25b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:42.119956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5133-1438-40bb-9c95-e6d9d399f25b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:42.120323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f5133-1438-40bb-9c95-e6d9d399f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:42.190337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ee5f5133-1438-40bb-9c95-e6d9d399f25b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:42.191652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ee5f5133-1438-40bb-9c95-e6d9d399f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:42.292997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 664/1326] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:29:42.344123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:42.344594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:42.345615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:42.346932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 663/1327] 10.222.0.32 () {54 vars in 964 bytes} [Thu Feb 10 03:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:42.353602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392c448-9f82-4416-b06a-65eb8fb881c3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:42.353898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392c448-9f82-4416-b06a-65eb8fb881c3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:42.354182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392c448-9f82-4416-b06a-65eb8fb881c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:42.441636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b392c448-9f82-4416-b06a-65eb8fb881c3 None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:42.442800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b392c448-9f82-4416-b06a-65eb8fb881c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:42.533155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 665/1328] 10.222.0.32 () {58 vars in 1061 bytes} [Thu Feb 10 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:42.543002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:42.544557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:42.664792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564b78-b3c5-44c7-9045-291a5bbf1a68 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:42.761347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118acca-d237-4414-9c78-83830373baea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:42.761783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acca-d237-4414-9c78-83830373baea service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:42.762006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acca-d237-4414-9c78-83830373baea service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:42.762278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118acca-d237-4414-9c78-83830373baea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:42.764153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1118acca-d237-4414-9c78-83830373baea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:42.896977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118acca-d237-4414-9c78-83830373baea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:42.898742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118acca-d237-4414-9c78-83830373baea service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:42.917568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 664/1329] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:45.454439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:45.455075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:45.455075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:45.458099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 666/1330] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:45.465567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13540c-b74a-4710-83dc-8f2fecef4ebc None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:45.466178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13540c-b74a-4710-83dc-8f2fecef4ebc None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:45.466552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13540c-b74a-4710-83dc-8f2fecef4ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:45.551833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6f13540c-b74a-4710-83dc-8f2fecef4ebc None None] MFA Rules not processed for user `5707e260eb2943eebfe40a32c3e5b3da`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:45.553050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6f13540c-b74a-4710-83dc-8f2fecef4ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:45.662705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 665/1331] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:45.702294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:45.707616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:45.832017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaab27e-131d-413a-a959-275e4f2bb8f9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:45.920470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:45.921172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:45.921458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:45.921728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:45.923529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:46.048785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:46.050224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2d07-b58c-424b-a356-874e5be73f20 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:46.070521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 667/1332] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:48.745841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:48.746754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:48.746754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:48.748615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 666/1333] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:48.754818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26379-51bb-4ba6-a3fa-a2e76ef15027 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:48.755374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26379-51bb-4ba6-a3fa-a2e76ef15027 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:48.755374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26379-51bb-4ba6-a3fa-a2e76ef15027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:48.832821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7ed26379-51bb-4ba6-a3fa-a2e76ef15027 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:48.834639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7ed26379-51bb-4ba6-a3fa-a2e76ef15027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:48.945034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 668/1334] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:48.980897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:48.982476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:49.114214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179c14-860c-4e09-b10b-56ce52696162 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:49.201187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:49.201752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:49.202034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:49.202296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:49.204136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:49.356140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:49.357619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2c568-bda4-4ac8-a71b-289de5f132fd service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:49.382064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 667/1335] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:51.689993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:51.690726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:51.690726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:51.692429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 669/1336] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:51.698455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709082-6694-4efa-924f-bfd06f24a59f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:51.698981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709082-6694-4efa-924f-bfd06f24a59f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:51.699082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a709082-6694-4efa-924f-bfd06f24a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:51.764000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0a709082-6694-4efa-924f-bfd06f24a59f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:51.765218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0a709082-6694-4efa-924f-bfd06f24a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:51.865504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 668/1337] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:51.907190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:51.908736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:52.014379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682be54-6302-457a-bc5e-cf1c3082fd22 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:52.090812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:52.091498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:52.091781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:52.092056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:52.093682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:52.202327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:52.203890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc1ca0-8459-4494-be4e-f6514cbf59ee service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:52.223126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 670/1338] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:54.764808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:54.765790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:54.765790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:54.767555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 669/1339] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:54.775297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55d13-4cb9-4b7f-a15a-de79c40f41fb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:54.775795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55d13-4cb9-4b7f-a15a-de79c40f41fb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:54.775892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55d13-4cb9-4b7f-a15a-de79c40f41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:54.847271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-80b55d13-4cb9-4b7f-a15a-de79c40f41fb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:54.848470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-80b55d13-4cb9-4b7f-a15a-de79c40f41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:54.963859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 671/1340] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:55.001723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:55.005190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:55.107520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980d624-7040-4629-b2fb-9a54fcf8c946 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:55.111347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:55.112002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:55.112274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:55.112539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:55.122114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:55.123940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9b3f-5f62-46a3-afef-bb5c4f0e27fb service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:55.133477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 670/1341] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:29:59.680708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334ebe4-a4bd-40a9-a9dc-a593cdd43e2c None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:59.681282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334ebe4-a4bd-40a9-a9dc-a593cdd43e2c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:59.681282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334ebe4-a4bd-40a9-a9dc-a593cdd43e2c None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:59.685757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 672/1342] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:29:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:29:59.688834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e78c2-c01b-43de-8d90-2eb564c4bc9c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:59.689321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e78c2-c01b-43de-8d90-2eb564c4bc9c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:59.689435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e78c2-c01b-43de-8d90-2eb564c4bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:59.719453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1d9e78c2-c01b-43de-8d90-2eb564c4bc9c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:29:59.720659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1d9e78c2-c01b-43de-8d90-2eb564c4bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:29:59.799523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 671/1343] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:29:59.839071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334ebe4-a4bd-40a9-a9dc-a593cdd43e2c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:29:59.852240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334ebe4-a4bd-40a9-a9dc-a593cdd43e2c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:29:59.856354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:29:59.857250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:29:59.857743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:29:59.858003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:29:59.868155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:29:59.869544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6efff-397e-484d-af35-52fdbb81b075 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:29:59.880265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 673/1344] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:02.906056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15ce2-c3cd-40d0-85be-bfb92da13c07 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:02.906616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15ce2-c3cd-40d0-85be-bfb92da13c07 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:02.906870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15ce2-c3cd-40d0-85be-bfb92da13c07 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:02.909146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 672/1345] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:02.915846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef7f-4569-4326-a2ec-aa25a421a2f6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:02.916351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef7f-4569-4326-a2ec-aa25a421a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:02.917266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef7f-4569-4326-a2ec-aa25a421a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:02.945239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-326bef7f-4569-4326-a2ec-aa25a421a2f6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:02.946806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-326bef7f-4569-4326-a2ec-aa25a421a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:02.957626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 674/1346] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:02.996053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd15ce2-c3cd-40d0-85be-bfb92da13c07 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:03.008518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd15ce2-c3cd-40d0-85be-bfb92da13c07 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:03.012579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:03.013392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:03.013672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:03.013940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:03.024894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:03.026765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc29fc1-efd2-4bef-a17a-0bc0569e8089 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:03.037889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 673/1347] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:30:07.421896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddb56-75ac-44b9-a97c-38a6c3603ac6 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:07.422406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddb56-75ac-44b9-a97c-38a6c3603ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:07.422406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ddb56-75ac-44b9-a97c-38a6c3603ac6 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:07.424188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 675/1348] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:07.430283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318581e5-8e79-4f63-b53a-300fa2c93c4f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:07.430771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318581e5-8e79-4f63-b53a-300fa2c93c4f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:07.431205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318581e5-8e79-4f63-b53a-300fa2c93c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:07.451707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-318581e5-8e79-4f63-b53a-300fa2c93c4f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:07.452992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-318581e5-8e79-4f63-b53a-300fa2c93c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:07.462494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 674/1349] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:07.501083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ddb56-75ac-44b9-a97c-38a6c3603ac6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:07.514458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ddb56-75ac-44b9-a97c-38a6c3603ac6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:07.518499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:07.519284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:07.519537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:07.520494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:07.531054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:07.532775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c46e8d-e1e9-495b-8d6c-294ec573ae56 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:07.543701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 676/1350] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:13.784444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d42b5d-5aa5-4614-9368-269b0318ca04 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:13.785709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d42b5d-5aa5-4614-9368-269b0318ca04 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:13.787031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d42b5d-5aa5-4614-9368-269b0318ca04 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:13.792910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 675/1351] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:30:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:13.803436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a16a-3fff-42f9-b33e-37a9215561fc None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:13.803436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a16a-3fff-42f9-b33e-37a9215561fc None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:13.804284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a16a-3fff-42f9-b33e-37a9215561fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:14.021048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4166a16a-3fff-42f9-b33e-37a9215561fc None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:14.023914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4166a16a-3fff-42f9-b33e-37a9215561fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:14.145647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 677/1352] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:19.634541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c44f3-9779-4dff-9c10-0b2b0a6a1a24 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:19.635266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c44f3-9779-4dff-9c10-0b2b0a6a1a24 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:19.635266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c44f3-9779-4dff-9c10-0b2b0a6a1a24 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:19.637091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 676/1353] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:19.644478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39a96-bb86-4c61-9fea-92a0a21818e7 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:19.645094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39a96-bb86-4c61-9fea-92a0a21818e7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:19.645257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39a96-bb86-4c61-9fea-92a0a21818e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:19.665931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-67f39a96-bb86-4c61-9fea-92a0a21818e7 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:19.667196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-67f39a96-bb86-4c61-9fea-92a0a21818e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:19.680623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 678/1354] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:30:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:21.632628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520000f-f3f6-46e2-a1e5-d0c1be2a337b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:21.633493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520000f-f3f6-46e2-a1e5-d0c1be2a337b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:21.633770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520000f-f3f6-46e2-a1e5-d0c1be2a337b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:21.635611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 677/1355] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:21.641451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec890a8-8132-4b46-9d7a-21a968c18078 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:21.641885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec890a8-8132-4b46-9d7a-21a968c18078 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:21.641885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec890a8-8132-4b46-9d7a-21a968c18078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:21.660682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8ec890a8-8132-4b46-9d7a-21a968c18078 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:21.661879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8ec890a8-8132-4b46-9d7a-21a968c18078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:21.671639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 679/1356] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:25.613981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182158c-3544-4e9f-833d-10424811f4c4 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:25.615152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182158c-3544-4e9f-833d-10424811f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:25.615152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182158c-3544-4e9f-833d-10424811f4c4 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:25.622911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 678/1357] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:25.625103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec989c3-1383-4b27-8976-8078d10a206d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:25.625878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec989c3-1383-4b27-8976-8078d10a206d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:25.625878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec989c3-1383-4b27-8976-8078d10a206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:25.655021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8ec989c3-1383-4b27-8976-8078d10a206d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:25.656750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8ec989c3-1383-4b27-8976-8078d10a206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:25.671402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 680/1358] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:25.730377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e7d5-5710-4589-a68e-3717f462a2b1 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:25.731684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e7d5-5710-4589-a68e-3717f462a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:25.732251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e7d5-5710-4589-a68e-3717f462a2b1 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:25.734344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 679/1359] 10.222.0.32 () {54 vars in 961 bytes} [Thu Feb 10 03:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:25.745123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35c99-60a0-4702-9af9-3b7993eb648e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:25.745926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35c99-60a0-4702-9af9-3b7993eb648e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:25.746995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35c99-60a0-4702-9af9-3b7993eb648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:25.824184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-73f35c99-60a0-4702-9af9-3b7993eb648e None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:25.825664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-73f35c99-60a0-4702-9af9-3b7993eb648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:25.923275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 681/1360] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Feb 10 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:25.936600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e7d5-5710-4589-a68e-3717f462a2b1 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:25.952858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e7d5-5710-4589-a68e-3717f462a2b1 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:25.959054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:25.959855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:25.960135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:25.960402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:25.975080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:25.979769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f200b-b14f-4365-bac9-1fab1012f564 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:26.006162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 680/1361] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:28.956096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30faa-02ff-4695-8d3b-2cb7ed0fdb5e None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:28.956880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30faa-02ff-4695-8d3b-2cb7ed0fdb5e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:28.956880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30faa-02ff-4695-8d3b-2cb7ed0fdb5e None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:28.958274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 682/1362] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:28.967982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ac4c-51fc-4a7a-8513-4994283c8728 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:28.968521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ac4c-51fc-4a7a-8513-4994283c8728 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:28.968932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ac4c-51fc-4a7a-8513-4994283c8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:28.992736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-27a7ac4c-51fc-4a7a-8513-4994283c8728 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:28.994029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-27a7ac4c-51fc-4a7a-8513-4994283c8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:29.007257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 681/1363] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:29.088572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30faa-02ff-4695-8d3b-2cb7ed0fdb5e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:29.117070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30faa-02ff-4695-8d3b-2cb7ed0fdb5e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:29.129114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:29.130356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:29.131188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:29.131992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:29.147925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:29.151044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242ea9c-0f52-427d-a949-4353c80c2556 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:29.169993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 683/1364] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:32.341912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148df44-76f9-41dc-9ed0-4222ad767043 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:32.343100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148df44-76f9-41dc-9ed0-4222ad767043 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:32.343398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148df44-76f9-41dc-9ed0-4222ad767043 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:32.345667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 682/1365] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:32.351898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0571-38d7-4845-a03a-377c74c552f5 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:32.352651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0571-38d7-4845-a03a-377c74c552f5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:32.352651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0571-38d7-4845-a03a-377c74c552f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:32.384153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ab3c0571-38d7-4845-a03a-377c74c552f5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:32.387741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ab3c0571-38d7-4845-a03a-377c74c552f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:32.401406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 684/1366] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:32.450348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f971e3-cb30-452e-ad2c-eb160fe46a2e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:32.450968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f971e3-cb30-452e-ad2c-eb160fe46a2e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:32.451237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f971e3-cb30-452e-ad2c-eb160fe46a2e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:32.453216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 683/1367] 10.222.0.32 () {54 vars in 961 bytes} [Thu Feb 10 03:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:30:32.459346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafe75-e917-4883-931e-8767265982c1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:32.460032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafe75-e917-4883-931e-8767265982c1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:32.460476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafe75-e917-4883-931e-8767265982c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:32.497009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bafafe75-e917-4883-931e-8767265982c1 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:32.498602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bafafe75-e917-4883-931e-8767265982c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:32.511136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 685/1368] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Feb 10 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:32.520044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f971e3-cb30-452e-ad2c-eb160fe46a2e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:32.546801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f971e3-cb30-452e-ad2c-eb160fe46a2e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:32.561222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:32.562694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:32.562694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:32.562694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:32.573102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:32.575170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54d328-c744-43d6-b6a4-b87269905bf9 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:32.596685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 684/1369] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:36.035749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961cdc5-7f2a-44c4-b122-cc118f8418d7 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.036630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961cdc5-7f2a-44c4-b122-cc118f8418d7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.037048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961cdc5-7f2a-44c4-b122-cc118f8418d7 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.045075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196306-a795-40f8-bbcb-3f8c87e06dde None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.045950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196306-a795-40f8-bbcb-3f8c87e06dde None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.046365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196306-a795-40f8-bbcb-3f8c87e06dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.049013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 686/1370] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:36.066324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8f196306-a795-40f8-bbcb-3f8c87e06dde None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:36.068118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f196306-a795-40f8-bbcb-3f8c87e06dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:36.077346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 685/1371] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:36.354835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10fbef-34db-4d6f-b9ad-83d82c8a69bb None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.355516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10fbef-34db-4d6f-b9ad-83d82c8a69bb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.356036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10fbef-34db-4d6f-b9ad-83d82c8a69bb None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.358114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 687/1372] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:36.367785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.367785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.367785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.392094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:36.393057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd59-2b39-405d-a81d-b6a5a91f0348 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.393276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:36.393423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd59-2b39-405d-a81d-b6a5a91f0348 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.393662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd59-2b39-405d-a81d-b6a5a91f0348 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.397168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 688/1373] 10.222.0.32 () {54 vars in 963 bytes} [Thu Feb 10 03:30:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:36.404518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 686/1374] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:36.410086 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d21b-7935-4930-8c05-fa7db5e5e9ea None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.410347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d21b-7935-4930-8c05-fa7db5e5e9ea None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.410638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6d21b-7935-4930-8c05-fa7db5e5e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.461425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:36.486022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4850fc5-1714-477f-9a1d-b57058e79781 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:36.496132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:36.498112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.498112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.498622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.504067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-80c6d21b-7935-4930-8c05-fa7db5e5e9ea None None] MFA Rules not processed for user `87ef495cf58846848130382884d739e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:36.505789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-80c6d21b-7935-4930-8c05-fa7db5e5e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:36.515820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:36.519265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:36.542919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 687/1375] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:36.631473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 689/1376] 10.222.0.32 () {58 vars in 1060 bytes} [Thu Feb 10 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:36.645623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:36.663755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcbd5-04d2-483f-8d79-ae007dd681f7 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:36.668431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:36.669128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:36.669394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:36.669669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:36.686738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:36.688965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ccb3a-0878-48e4-93b3-6a55726bcb60 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:36.702291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 688/1377] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:39.333694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145820f-2a4d-4443-b783-396108eafafd None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:39.333694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145820f-2a4d-4443-b783-396108eafafd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:39.333694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145820f-2a4d-4443-b783-396108eafafd None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:39.337993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 690/1378] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:39.341630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3550c-3231-4fcc-9f6b-dd09154f9d26 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:39.342186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3550c-3231-4fcc-9f6b-dd09154f9d26 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:39.342879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3550c-3231-4fcc-9f6b-dd09154f9d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:39.372199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b6b3550c-3231-4fcc-9f6b-dd09154f9d26 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:39.373844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b6b3550c-3231-4fcc-9f6b-dd09154f9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:39.383509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 689/1379] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:39.450921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145820f-2a4d-4443-b783-396108eafafd None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:39.471089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145820f-2a4d-4443-b783-396108eafafd None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:39.477184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:39.478088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:39.479308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:39.479765 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:39.495438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:39.497421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d530185-2aa5-468f-871a-2c82f0e9bd5f service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:39.509607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 691/1380] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:42.259726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3da-1c69-42aa-8436-e824cd02eacf None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:42.260617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3da-1c69-42aa-8436-e824cd02eacf None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:42.260885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3da-1c69-42aa-8436-e824cd02eacf None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:42.265824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 690/1381] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:30:42.268900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e259ec-60b3-4ab9-8847-b79686f89e47 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:42.269618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e259ec-60b3-4ab9-8847-b79686f89e47 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:42.269618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e259ec-60b3-4ab9-8847-b79686f89e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:42.288932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f4e259ec-60b3-4ab9-8847-b79686f89e47 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:42.290136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f4e259ec-60b3-4ab9-8847-b79686f89e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:42.299258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 692/1382] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:42.345157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a3da-1c69-42aa-8436-e824cd02eacf None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:42.370576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a3da-1c69-42aa-8436-e824cd02eacf None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:42.380451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:42.381746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:42.382375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:42.383027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:42.398937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:42.402248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609a532-e7c8-47dc-9a03-d18124c2d5f6 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:42.421248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 691/1383] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:45.148311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821df1-92f7-4aaa-bd50-5f4e69a80c92 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:45.148972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821df1-92f7-4aaa-bd50-5f4e69a80c92 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:45.148972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821df1-92f7-4aaa-bd50-5f4e69a80c92 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:45.151835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 693/1384] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:45.156791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482290f-4553-4fef-b1b4-826c33da2f01 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:45.157373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482290f-4553-4fef-b1b4-826c33da2f01 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:45.157373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482290f-4553-4fef-b1b4-826c33da2f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:45.178277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8482290f-4553-4fef-b1b4-826c33da2f01 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:45.179879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8482290f-4553-4fef-b1b4-826c33da2f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:45.189233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 692/1385] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:45.232471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821df1-92f7-4aaa-bd50-5f4e69a80c92 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:45.250425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821df1-92f7-4aaa-bd50-5f4e69a80c92 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:45.257249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:45.258319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:45.258604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:45.258922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:45.269442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:45.271193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec3585-2bad-4fb8-b798-580dc5d02302 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:45.283061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 694/1386] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:47.733479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320a21-76b2-4e90-a58e-819a3f2409da None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:47.734151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320a21-76b2-4e90-a58e-819a3f2409da None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:47.734151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320a21-76b2-4e90-a58e-819a3f2409da None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:47.736443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 693/1387] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:47.743381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a9f9-b8cb-4aa3-96b2-cbe3e7ecaadd None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:47.743956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a9f9-b8cb-4aa3-96b2-cbe3e7ecaadd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:47.744090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a9f9-b8cb-4aa3-96b2-cbe3e7ecaadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:47.765590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e957a9f9-b8cb-4aa3-96b2-cbe3e7ecaadd None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:47.767148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e957a9f9-b8cb-4aa3-96b2-cbe3e7ecaadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:47.776556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 695/1388] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:47.823503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320a21-76b2-4e90-a58e-819a3f2409da None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:47.839287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320a21-76b2-4e90-a58e-819a3f2409da None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:47.845764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:47.846354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:47.847163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:47.847163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:47.856399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:47.858064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4600d7-bcb4-427b-a1cd-252b7bce2f1b service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:47.868077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 694/1389] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:50.362754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627a7d-30be-45d1-b483-119e8ca37677 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:50.363337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627a7d-30be-45d1-b483-119e8ca37677 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:50.363496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627a7d-30be-45d1-b483-119e8ca37677 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:50.365792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 696/1390] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:50.372170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb908a-93ba-4bd4-a13a-7a1a333aaa54 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:50.372718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb908a-93ba-4bd4-a13a-7a1a333aaa54 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:50.372718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb908a-93ba-4bd4-a13a-7a1a333aaa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:50.393583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2fcb908a-93ba-4bd4-a13a-7a1a333aaa54 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:50.394920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2fcb908a-93ba-4bd4-a13a-7a1a333aaa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:50.403550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 695/1391] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:50.449943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e627a7d-30be-45d1-b483-119e8ca37677 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:50.465642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e627a7d-30be-45d1-b483-119e8ca37677 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:50.471213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:50.471919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:50.472207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:50.472489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:50.481936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:50.483639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1e89-c99b-4b97-865f-bfe4bce30d11 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:50.494260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 697/1392] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:52.961164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c838a-2542-4659-b92e-dcf564857285 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:52.961789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c838a-2542-4659-b92e-dcf564857285 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:52.961789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c838a-2542-4659-b92e-dcf564857285 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:52.963935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 696/1393] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:52.971236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb009a0-a834-4677-ae8e-5565f0ce0b8a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:52.972329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb009a0-a834-4677-ae8e-5565f0ce0b8a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:52.972630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb009a0-a834-4677-ae8e-5565f0ce0b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:52.996045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-deb009a0-a834-4677-ae8e-5565f0ce0b8a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:52.998459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-deb009a0-a834-4677-ae8e-5565f0ce0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:53.007502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 698/1394] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:53.058309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c838a-2542-4659-b92e-dcf564857285 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:53.074944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c838a-2542-4659-b92e-dcf564857285 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:53.081020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:53.081699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:53.081974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:53.082248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:53.091433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:53.093083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880df9b-7687-456b-9ea7-98b517a0d064 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:53.104233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 697/1395] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:30:55.509877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df21dc-06ff-4516-9769-c44e03b81ec9 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:55.510433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df21dc-06ff-4516-9769-c44e03b81ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:55.510826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df21dc-06ff-4516-9769-c44e03b81ec9 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:55.514993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 699/1396] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:55.524941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97c29-d45d-451e-9089-7c8383188148 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:55.525553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97c29-d45d-451e-9089-7c8383188148 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:55.526051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac97c29-d45d-451e-9089-7c8383188148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:55.557079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bac97c29-d45d-451e-9089-7c8383188148 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:55.559252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bac97c29-d45d-451e-9089-7c8383188148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:55.570980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 698/1397] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:55.624008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df21dc-06ff-4516-9769-c44e03b81ec9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:55.639181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df21dc-06ff-4516-9769-c44e03b81ec9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:55.644751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:55.645419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:55.645696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:55.645972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:55.655393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:55.657063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468f711-5722-4e07-ab18-5b9fcc05708c service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:55.667638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 700/1398] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:57.087328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fdd7-150e-4a40-96da-e7ec28be2d1f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.088242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fdd7-150e-4a40-96da-e7ec28be2d1f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.088518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fdd7-150e-4a40-96da-e7ec28be2d1f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:57.090348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 699/1399] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:30:57.096730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438547-3442-4699-8a5a-3f7e18d3ba83 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.097229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438547-3442-4699-8a5a-3f7e18d3ba83 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.097600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438547-3442-4699-8a5a-3f7e18d3ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:57.119786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f9438547-3442-4699-8a5a-3f7e18d3ba83 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:57.122310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f9438547-3442-4699-8a5a-3f7e18d3ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:57.136524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 701/1400] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:57.212131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af942-626a-49c9-b7e4-a2e368c7529c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.212532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af942-626a-49c9-b7e4-a2e368c7529c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.212842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af942-626a-49c9-b7e4-a2e368c7529c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:57.215046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 700/1401] 10.222.0.32 () {54 vars in 962 bytes} [Thu Feb 10 03:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:57.220640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4770d-0193-4257-888a-e947cbd18c44 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.221104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4770d-0193-4257-888a-e947cbd18c44 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.221597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4770d-0193-4257-888a-e947cbd18c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:57.300440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-46e4770d-0193-4257-888a-e947cbd18c44 None None] MFA Rules not processed for user `12399215913a4d619dc6be7f0c037347`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:57.302614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-46e4770d-0193-4257-888a-e947cbd18c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:57.380383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 702/1402] 10.222.0.32 () {58 vars in 1059 bytes} [Thu Feb 10 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:57.388229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9af942-626a-49c9-b7e4-a2e368c7529c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:57.404357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9af942-626a-49c9-b7e4-a2e368c7529c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:57.408383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:57.409206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.409478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.409747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:57.419886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:57.421450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b18cdd-cc51-4b28-8dcc-7fa5562bd4b1 service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:57.431661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 701/1403] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:57.990727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a8af-c74c-49c2-98f5-e4a2e84d6147 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:57.991097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a8af-c74c-49c2-98f5-e4a2e84d6147 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:57.991377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a8af-c74c-49c2-98f5-e4a2e84d6147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.056610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f686a8af-c74c-49c2-98f5-e4a2e84d6147 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:58.058833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f686a8af-c74c-49c2-98f5-e4a2e84d6147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:58.125587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6699d-8f36-4785-8127-cfb1479257e3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.126143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6699d-8f36-4785-8127-cfb1479257e3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.126143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6699d-8f36-4785-8127-cfb1479257e3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.127950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 702/1404] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:30:58.133370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.133891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.134488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.150364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 703/1405] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:30:58.152529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:58.153736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:58.164486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 703/1406] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:58.209021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:58.210564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8021-db78-413c-aee6-59e2a438d765 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.211051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8021-db78-413c-aee6-59e2a438d765 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.211970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8021-db78-413c-aee6-59e2a438d765 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.215193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 704/1407] 10.222.0.32 () {54 vars in 942 bytes} [Thu Feb 10 03:30:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:30:58.222007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d126e6-5f19-4614-ac97-fb37756445bb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.222440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d126e6-5f19-4614-ac97-fb37756445bb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.222787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d126e6-5f19-4614-ac97-fb37756445bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.223586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2115-531e-4679-9930-8023e8924982 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:58.230552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:58.231172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.231446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.231714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.241415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:58.243049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:58.253244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 704/1408] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:30:58.283975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-08d126e6-5f19-4614-ac97-fb37756445bb None None] MFA Rules not processed for user `b2e93de4f4c34d25bbb086fc94bca1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:30:58.285182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-08d126e6-5f19-4614-ac97-fb37756445bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:30:58.372771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 705/1409] 10.222.0.32 () {58 vars in 1039 bytes} [Thu Feb 10 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:30:58.383140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:30:58.394969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da828c-620f-4158-acd5-a27ce687f3a9 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:30:58.400464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:30:58.401138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:30:58.401415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:30:58.401687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:30:58.411723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:30:58.413381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221df91-cd3f-482d-a0cd-e63720c7b16b service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:30:58.423580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 705/1410] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:30:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:31:20.520464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42b2-83f2-4afc-8bb6-3d00438310ba None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:20.521121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42b2-83f2-4afc-8bb6-3d00438310ba None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:20.521121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc42b2-83f2-4afc-8bb6-3d00438310ba None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:20.522822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 706/1411] 10.222.0.32 () {54 vars in 918 bytes} [Thu Feb 10 03:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:20.528410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4fc0-8bd5-4891-9c00-e2c56fbc6bd6 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:20.528882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4fc0-8bd5-4891-9c00-e2c56fbc6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:20.529010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4fc0-8bd5-4891-9c00-e2c56fbc6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:20.547521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-95fe4fc0-8bd5-4891-9c00-e2c56fbc6bd6 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:20.548724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-95fe4fc0-8bd5-4891-9c00-e2c56fbc6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:20.557991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 706/1412] 10.222.0.32 () {58 vars in 1015 bytes} [Thu Feb 10 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:20.573433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6489a-534f-481d-955f-8229e30af661 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:20.573681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6489a-534f-481d-955f-8229e30af661 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:20.573982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6489a-534f-481d-955f-8229e30af661 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:20.575814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 707/1413] 10.222.0.32 () {54 vars in 918 bytes} [Thu Feb 10 03:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:20.580707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cf34-8be6-4b3c-91b4-cabeae09b22c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:20.580978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cf34-8be6-4b3c-91b4-cabeae09b22c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:20.581282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cf34-8be6-4b3c-91b4-cabeae09b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:20.601536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-10a8cf34-8be6-4b3c-91b4-cabeae09b22c None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:20.603104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-10a8cf34-8be6-4b3c-91b4-cabeae09b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:20.612890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 707/1414] 10.222.0.32 () {58 vars in 1015 bytes} [Thu Feb 10 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:23.325197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9500a-caa0-4838-809a-011d705e791d None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:23.325788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9500a-caa0-4838-809a-011d705e791d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:23.325788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9500a-caa0-4838-809a-011d705e791d None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:23.327566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 708/1415] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:23.333607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab34e-4250-42bb-bc75-94d5db302c5c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:23.334086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab34e-4250-42bb-bc75-94d5db302c5c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:23.334208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab34e-4250-42bb-bc75-94d5db302c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:23.354128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6a4ab34e-4250-42bb-bc75-94d5db302c5c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:23.355393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6a4ab34e-4250-42bb-bc75-94d5db302c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:23.363947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 708/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:23.409250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9500a-caa0-4838-809a-011d705e791d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:23.425045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9500a-caa0-4838-809a-011d705e791d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:23.431446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:23.432097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:23.432372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:23.432653 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:23.441550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:23.443187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae20ca-2ca5-4ec3-901c-224b096875d0 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:23.453376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 709/1417] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:24.817295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544796-d328-4323-bbd1-ae1bddfb5c17 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:24.817900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544796-d328-4323-bbd1-ae1bddfb5c17 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:24.817900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544796-d328-4323-bbd1-ae1bddfb5c17 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:24.819696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:24.824999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0afa-3d43-480d-9883-37707e809b1c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:24.825458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0afa-3d43-480d-9883-37707e809b1c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:24.825572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad0afa-3d43-480d-9883-37707e809b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:24.844267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2fad0afa-3d43-480d-9883-37707e809b1c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:24.845459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2fad0afa-3d43-480d-9883-37707e809b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:24.854551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:25.008988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544796-d328-4323-bbd1-ae1bddfb5c17 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:25.024339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544796-d328-4323-bbd1-ae1bddfb5c17 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:25.030293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:25.030967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:25.031276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:25.031545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:25.040072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:25.041617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00456-43d6-4f0c-b178-cd4a0e9f1df2 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:25.051441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 710/1420] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:26.375210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fb05-a74f-41cf-8a35-69709c1dad18 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:26.375766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fb05-a74f-41cf-8a35-69709c1dad18 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:26.375766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fb05-a74f-41cf-8a35-69709c1dad18 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:26.377465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:26.383123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdca1-2bd5-42f8-8a70-5fb57659d1d2 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:26.383595 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdca1-2bd5-42f8-8a70-5fb57659d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:26.383692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdca1-2bd5-42f8-8a70-5fb57659d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:26.413359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c17bdca1-2bd5-42f8-8a70-5fb57659d1d2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:26.414564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c17bdca1-2bd5-42f8-8a70-5fb57659d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:26.423400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:26.575201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fb05-a74f-41cf-8a35-69709c1dad18 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:26.590343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fb05-a74f-41cf-8a35-69709c1dad18 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:26.595966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:26.596628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:26.597000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:26.597171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:26.606056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:26.607660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca62cec-fa21-4104-ac77-ead3e38aec19 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:26.617175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 712/1423] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:27.932783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965dcc8-9b01-46ce-a771-c85c233974e3 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:27.933324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965dcc8-9b01-46ce-a771-c85c233974e3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:27.933324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965dcc8-9b01-46ce-a771-c85c233974e3 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:27.935040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:27.940763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a42e-7dc9-441f-8b12-f3f4c9be4176 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:27.941229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a42e-7dc9-441f-8b12-f3f4c9be4176 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:27.941340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a42e-7dc9-441f-8b12-f3f4c9be4176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:27.959916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-54d9a42e-7dc9-441f-8b12-f3f4c9be4176 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:27.961117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-54d9a42e-7dc9-441f-8b12-f3f4c9be4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:27.970324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:31:28.121853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965dcc8-9b01-46ce-a771-c85c233974e3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:28.138269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965dcc8-9b01-46ce-a771-c85c233974e3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:28.144357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:28.144972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:28.145257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:28.145560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:28.153997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:28.155663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46ed5-b7dc-4507-8dc9-c6948d407866 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:28.165582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 713/1426] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:29.469786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb643-2a3d-4434-98d7-642d78314416 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:29.470392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb643-2a3d-4434-98d7-642d78314416 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:29.470392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb643-2a3d-4434-98d7-642d78314416 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:29.472820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:31:29.478853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6ae9-06d9-4943-92b8-06e260c1c18d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:29.479336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6ae9-06d9-4943-92b8-06e260c1c18d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:29.479613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6ae9-06d9-4943-92b8-06e260c1c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:29.500905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-633f6ae9-06d9-4943-92b8-06e260c1c18d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:29.502110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-633f6ae9-06d9-4943-92b8-06e260c1c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:29.514763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:29.669265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bb643-2a3d-4434-98d7-642d78314416 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:29.685984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bb643-2a3d-4434-98d7-642d78314416 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:29.692031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:29.692697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:29.692985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:29.693265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:29.702043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:29.703694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dad89-3fec-4379-aadf-cc16b3c1b794 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:29.713163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 715/1429] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:30.987199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1774f78-0a6e-4edd-b2cb-bc546cc02742 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:30.987744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1774f78-0a6e-4edd-b2cb-bc546cc02742 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:30.987744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1774f78-0a6e-4edd-b2cb-bc546cc02742 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:30.989600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:30.995190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f10b8-7fcb-452d-9089-ff15c2a05e99 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:30.995632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f10b8-7fcb-452d-9089-ff15c2a05e99 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:30.995766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f10b8-7fcb-452d-9089-ff15c2a05e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:31.015191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-588f10b8-7fcb-452d-9089-ff15c2a05e99 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:31.016521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-588f10b8-7fcb-452d-9089-ff15c2a05e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:31.025052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:31.175780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1774f78-0a6e-4edd-b2cb-bc546cc02742 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:31.191449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1774f78-0a6e-4edd-b2cb-bc546cc02742 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:31.197949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:31.198590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:31.198909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:31.199172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:31.208344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:31.209933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe46fc-35bf-4350-8419-cd774b68dccd service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:31.220044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 716/1432] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:32.482766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5537-3c29-4c8f-bd83-11f0b38cf9df None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:32.483425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5537-3c29-4c8f-bd83-11f0b38cf9df None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:32.483425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5537-3c29-4c8f-bd83-11f0b38cf9df None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:32.485243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:32.490391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166437-19ef-4c3f-9659-4259e9929469 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:32.490904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166437-19ef-4c3f-9659-4259e9929469 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:32.491002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166437-19ef-4c3f-9659-4259e9929469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:32.510330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a4166437-19ef-4c3f-9659-4259e9929469 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:32.511567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a4166437-19ef-4c3f-9659-4259e9929469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:32.519953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:32.670166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd5537-3c29-4c8f-bd83-11f0b38cf9df None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:32.686112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd5537-3c29-4c8f-bd83-11f0b38cf9df None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:32.691986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:32.692633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:32.692917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:32.693225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:32.702285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:32.703908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06026be5-51a3-4a0b-8746-d74fb4d63af1 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:32.713382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 718/1435] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:33.980851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fcdda-21a4-4d2a-858f-d508054d0f3f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:33.981419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fcdda-21a4-4d2a-858f-d508054d0f3f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:33.981419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fcdda-21a4-4d2a-858f-d508054d0f3f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:33.983132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:33.988757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd608-d834-47ae-a0e8-2ad32da6add6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:33.989232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd608-d834-47ae-a0e8-2ad32da6add6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:33.989328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd608-d834-47ae-a0e8-2ad32da6add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:34.013233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-73afd608-d834-47ae-a0e8-2ad32da6add6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:34.014930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-73afd608-d834-47ae-a0e8-2ad32da6add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:34.025083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:34.189657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fcdda-21a4-4d2a-858f-d508054d0f3f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:34.206500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fcdda-21a4-4d2a-858f-d508054d0f3f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:34.216133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:34.217121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:34.217594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:34.218014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:34.229625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:34.231348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dac154-d5cd-40a4-a2ec-dbcf8cd1e4e9 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:34.241337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 719/1438] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:35.500789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a9ab-c9ad-48fb-81c1-26427ed80223 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:35.501344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a9ab-c9ad-48fb-81c1-26427ed80223 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:35.501344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a9ab-c9ad-48fb-81c1-26427ed80223 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:35.503056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:35.508498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bda9d-8622-4827-829f-311a674b7823 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:35.508980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bda9d-8622-4827-829f-311a674b7823 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:35.509090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bda9d-8622-4827-829f-311a674b7823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:35.527477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-9c7bda9d-8622-4827-829f-311a674b7823 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:35.528690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9c7bda9d-8622-4827-829f-311a674b7823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:35.536842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:35.687550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a9ab-c9ad-48fb-81c1-26427ed80223 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:35.703030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a9ab-c9ad-48fb-81c1-26427ed80223 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:35.708696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:35.709342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:35.709625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:35.709903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:35.718471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:35.720158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da22486-73f6-4da7-b584-c2b8f7909cc3 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:35.729447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 721/1441] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:37.840651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438d2-c6b8-44ce-8c52-610f16ce3f82 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:37.841222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438d2-c6b8-44ce-8c52-610f16ce3f82 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:37.841222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438d2-c6b8-44ce-8c52-610f16ce3f82 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:37.843082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:37.849090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031344a-0a7b-47ec-9984-fc69765ad749 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:37.849501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031344a-0a7b-47ec-9984-fc69765ad749 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:37.849642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031344a-0a7b-47ec-9984-fc69765ad749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:37.867973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3031344a-0a7b-47ec-9984-fc69765ad749 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:37.869183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3031344a-0a7b-47ec-9984-fc69765ad749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:37.877808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:37.916777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068438d2-c6b8-44ce-8c52-610f16ce3f82 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:37.928324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068438d2-c6b8-44ce-8c52-610f16ce3f82 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:37.932844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:37.933528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:37.933806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:37.934074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:37.944573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:37.946028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bc350-6e3d-45f3-94d9-ae95ff6ff5d0 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:37.955811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 722/1444] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:40.384558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c8fc-d618-4fb7-9d2b-1999b51c259a None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:40.385205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c8fc-d618-4fb7-9d2b-1999b51c259a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:40.385205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c8fc-d618-4fb7-9d2b-1999b51c259a None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:40.386931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:40.392949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22600211-dd01-4ee6-bc7d-c93449a6b15c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:40.393404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22600211-dd01-4ee6-bc7d-c93449a6b15c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:40.393518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22600211-dd01-4ee6-bc7d-c93449a6b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:40.412635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-22600211-dd01-4ee6-bc7d-c93449a6b15c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:40.413848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-22600211-dd01-4ee6-bc7d-c93449a6b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:40.422953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:40.461940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c8fc-d618-4fb7-9d2b-1999b51c259a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:40.474195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c8fc-d618-4fb7-9d2b-1999b51c259a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:40.478074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:40.478736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:40.479015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:40.479284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:40.488822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:40.490251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd253f-5785-4b15-9502-7b81def0e218 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:40.500202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 724/1447] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:43.037423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc8f1-77f8-4d52-8412-63ede3479b93 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:43.037982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc8f1-77f8-4d52-8412-63ede3479b93 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:43.037982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc8f1-77f8-4d52-8412-63ede3479b93 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:43.039726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:43.045740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5501d2-add5-417f-aa9f-05737203febf None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:43.046303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5501d2-add5-417f-aa9f-05737203febf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:43.046303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5501d2-add5-417f-aa9f-05737203febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:43.065499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8a5501d2-add5-417f-aa9f-05737203febf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:43.066686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8a5501d2-add5-417f-aa9f-05737203febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:43.075409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:43.114227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc8f1-77f8-4d52-8412-63ede3479b93 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:43.126514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc8f1-77f8-4d52-8412-63ede3479b93 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:43.130848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:43.131498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:43.131776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:43.132045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:43.141647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:43.143364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9bd04-eb39-4ddd-b447-f3bb9bdcfc4a service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:43.152791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 725/1450] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:45.510906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64804-8274-4ffd-a47f-5e359c802d3a None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:45.511442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64804-8274-4ffd-a47f-5e359c802d3a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:45.511442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64804-8274-4ffd-a47f-5e359c802d3a None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:45.513148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:45.519580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3b26-a7e1-4293-980b-59f2b2f1e079 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:45.520053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3b26-a7e1-4293-980b-59f2b2f1e079 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:45.520155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3b26-a7e1-4293-980b-59f2b2f1e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:45.538945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a02c3b26-a7e1-4293-980b-59f2b2f1e079 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:45.540154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a02c3b26-a7e1-4293-980b-59f2b2f1e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:45.549100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:45.588046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64804-8274-4ffd-a47f-5e359c802d3a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:45.599618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64804-8274-4ffd-a47f-5e359c802d3a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:45.603384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:45.604027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:45.604308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:45.604577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:45.614061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:45.615546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8fdcd-a849-42b8-8be0-53c1e30c0d18 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:45.626058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 727/1453] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:47.899021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:47.899586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:47.899586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:47.901370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:47.907218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ead3c-9b55-495f-98a7-e312bee615a9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:47.907715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ead3c-9b55-495f-98a7-e312bee615a9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:47.907715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ead3c-9b55-495f-98a7-e312bee615a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:47.926719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-049ead3c-9b55-495f-98a7-e312bee615a9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:47.927835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-049ead3c-9b55-495f-98a7-e312bee615a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:47.936033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:47.974412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:47.976617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:47.991052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdbeff-4021-4758-9dbe-f63f3ef68d37 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:47.994800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:47.995439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:47.995714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:47.995984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:48.005705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:48.007162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9d937-7ec6-437d-aa79-5deee929f746 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:48.016580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 728/1456] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:50.308496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c29de-a69d-45d6-98b6-9565f07fc6a1 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:50.309071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c29de-a69d-45d6-98b6-9565f07fc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:50.309071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c29de-a69d-45d6-98b6-9565f07fc6a1 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:50.310891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:50.316447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b0ebf-96fe-408a-8405-8a3238ebe1d7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:50.316929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b0ebf-96fe-408a-8405-8a3238ebe1d7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:50.316929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b0ebf-96fe-408a-8405-8a3238ebe1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:50.335294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cb1b0ebf-96fe-408a-8405-8a3238ebe1d7 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:50.336487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cb1b0ebf-96fe-408a-8405-8a3238ebe1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:50.344882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:50.382952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c29de-a69d-45d6-98b6-9565f07fc6a1 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:50.394487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c29de-a69d-45d6-98b6-9565f07fc6a1 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:50.398001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:50.398638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:50.399022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:50.399294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:50.408640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:50.410076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa024da-452c-4707-985f-c9425c5a7581 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:50.419586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 730/1459] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:52.680677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5680483-bf34-4480-81b4-6cce7d9c7fa2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:52.681236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5680483-bf34-4480-81b4-6cce7d9c7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:52.681236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5680483-bf34-4480-81b4-6cce7d9c7fa2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:52.683032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:52.689005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4be320-eadf-4c78-8bd9-547c6bd79247 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:52.689480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4be320-eadf-4c78-8bd9-547c6bd79247 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:52.689604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4be320-eadf-4c78-8bd9-547c6bd79247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:52.707882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7e4be320-eadf-4c78-8bd9-547c6bd79247 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:52.709066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7e4be320-eadf-4c78-8bd9-547c6bd79247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:52.717379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:31:52.755341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5680483-bf34-4480-81b4-6cce7d9c7fa2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:52.766576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5680483-bf34-4480-81b4-6cce7d9c7fa2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:52.770445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:52.771134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:52.771408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:52.771677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:52.781188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:52.782633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480c4b9-fe54-451d-8ea4-9c53b40ca756 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:52.792719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 731/1462] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:55.063929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90cec-cecd-4957-8e19-d2c99b2312e7 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:55.064495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90cec-cecd-4957-8e19-d2c99b2312e7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:55.064495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e90cec-cecd-4957-8e19-d2c99b2312e7 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:55.066272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:55.071870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f448d-f1b5-4951-8d6c-f7ad8a5de5a9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:55.072338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f448d-f1b5-4951-8d6c-f7ad8a5de5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:55.072461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f448d-f1b5-4951-8d6c-f7ad8a5de5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:55.091401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-117f448d-f1b5-4951-8d6c-f7ad8a5de5a9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:55.092590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-117f448d-f1b5-4951-8d6c-f7ad8a5de5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:55.100879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:55.138184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e90cec-cecd-4957-8e19-d2c99b2312e7 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:55.149948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e90cec-cecd-4957-8e19-d2c99b2312e7 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:55.153952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:55.154632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:55.154947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:55.155223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:55.164455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:55.165902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdf292-7993-4d53-9bd1-08b5d7dd9df5 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:55.175327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 733/1465] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:57.429627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc9fe-49cc-4545-adab-27b37f39f3c2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:57.430238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc9fe-49cc-4545-adab-27b37f39f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:57.430238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc9fe-49cc-4545-adab-27b37f39f3c2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:57.431884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:57.437405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89002b27-3a4f-44f6-a1af-f18056bfd7af None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:57.437900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89002b27-3a4f-44f6-a1af-f18056bfd7af None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:57.438093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89002b27-3a4f-44f6-a1af-f18056bfd7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:57.457934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-89002b27-3a4f-44f6-a1af-f18056bfd7af None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:57.459296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-89002b27-3a4f-44f6-a1af-f18056bfd7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:57.468256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:57.504878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bc9fe-49cc-4545-adab-27b37f39f3c2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:57.516794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bc9fe-49cc-4545-adab-27b37f39f3c2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:57.520822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:57.521457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:57.521729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:57.521992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:57.531075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:57.532601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3da8a3-48cb-492c-8bb7-64ea3257e82d service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:57.541817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 734/1468] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:59.761333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5177a4-dfe5-4309-8f4f-dfd0f616ac69 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:59.761934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5177a4-dfe5-4309-8f4f-dfd0f616ac69 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:59.761934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5177a4-dfe5-4309-8f4f-dfd0f616ac69 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:59.763696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:31:59.770638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15009a1-ea16-4726-a811-1a484fba4298 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:59.771415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15009a1-ea16-4726-a811-1a484fba4298 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:59.771614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15009a1-ea16-4726-a811-1a484fba4298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:59.794114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a15009a1-ea16-4726-a811-1a484fba4298 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:31:59.795371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a15009a1-ea16-4726-a811-1a484fba4298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:31:59.803928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:31:59.841281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5177a4-dfe5-4309-8f4f-dfd0f616ac69 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:31:59.852728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5177a4-dfe5-4309-8f4f-dfd0f616ac69 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:31:59.856682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:31:59.857385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:31:59.857710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:31:59.858029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:31:59.868005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:31:59.869460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51ee19-e581-4005-82c1-df0bfaf41700 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:31:59.879823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 736/1471] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:32:16.403115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27869-44fe-4f71-bd3b-17f17f18c45c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:16.403818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27869-44fe-4f71-bd3b-17f17f18c45c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:16.403818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27869-44fe-4f71-bd3b-17f17f18c45c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:16.405442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 736/1472] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:16.412928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ba-806b-4bc2-9191-5f55d67d0e51 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:16.413473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ba-806b-4bc2-9191-5f55d67d0e51 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:16.413958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ba-806b-4bc2-9191-5f55d67d0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:16.435375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-da8094ba-806b-4bc2-9191-5f55d67d0e51 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:16.436599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-da8094ba-806b-4bc2-9191-5f55d67d0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:16.454975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 737/1473] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:32:16.497292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248dca-85cb-4b3d-987c-eba72f58bf18 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:16.497598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248dca-85cb-4b3d-987c-eba72f58bf18 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:16.497852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248dca-85cb-4b3d-987c-eba72f58bf18 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:16.500326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 737/1474] 10.222.0.32 () {54 vars in 962 bytes} [Thu Feb 10 03:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:32:16.505226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650d2-77ef-4f2b-ace5-d462ee230d93 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:16.505512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650d2-77ef-4f2b-ace5-d462ee230d93 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:16.505789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650d2-77ef-4f2b-ace5-d462ee230d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:16.536602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6f4650d2-77ef-4f2b-ace5-d462ee230d93 None None] MFA Rules not processed for user `12399215913a4d619dc6be7f0c037347`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:16.537822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6f4650d2-77ef-4f2b-ace5-d462ee230d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:16.544459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 738/1475] 10.222.0.32 () {58 vars in 1059 bytes} [Thu Feb 10 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:16.551994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248dca-85cb-4b3d-987c-eba72f58bf18 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:16.563321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248dca-85cb-4b3d-987c-eba72f58bf18 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:16.566964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:16.567608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:16.567881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:16.568146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:16.580737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:16.582537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02133b2-f154-4b25-93dc-2ac27634307d service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:16.596683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 738/1476] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:32:18.926552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dbed7-cfb4-45b5-89d8-0404a03a7de5 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:18.927162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dbed7-cfb4-45b5-89d8-0404a03a7de5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:18.927162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dbed7-cfb4-45b5-89d8-0404a03a7de5 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:18.928902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 739/1477] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:18.935094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9acf-d46d-4f66-bf63-ae1b17ee2215 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:18.935632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9acf-d46d-4f66-bf63-ae1b17ee2215 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:18.935632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9acf-d46d-4f66-bf63-ae1b17ee2215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:18.954954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a5ad9acf-d46d-4f66-bf63-ae1b17ee2215 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:18.956101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a5ad9acf-d46d-4f66-bf63-ae1b17ee2215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:18.964518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 739/1478] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:18.987802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dbed7-cfb4-45b5-89d8-0404a03a7de5 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:19.002020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dbed7-cfb4-45b5-89d8-0404a03a7de5 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:19.006963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:19.007622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:19.007910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:19.008184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:19.008927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:19.010804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c439c7-d6c9-4216-92fc-8f584b354fcd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:19.030250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 740/1479] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Feb 10 03:32:18 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:32:21.306786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d91f-22c9-4db8-a6ac-0a8f04579d0c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:21.307404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d91f-22c9-4db8-a6ac-0a8f04579d0c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:21.307404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d91f-22c9-4db8-a6ac-0a8f04579d0c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:21.309115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 740/1480] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:21.315195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cf81-367e-49b8-9dba-d77eafc73106 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:21.315652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cf81-367e-49b8-9dba-d77eafc73106 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:21.315811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cf81-367e-49b8-9dba-d77eafc73106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:21.334966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5da0cf81-367e-49b8-9dba-d77eafc73106 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:21.336227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5da0cf81-367e-49b8-9dba-d77eafc73106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:21.346276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 741/1481] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:21.388813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d91f-22c9-4db8-a6ac-0a8f04579d0c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:21.404925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d91f-22c9-4db8-a6ac-0a8f04579d0c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:21.411102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:21.411785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:21.412064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:21.412340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:21.421586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:21.423335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5d44-6b05-4c59-a58b-7b3dac13c452 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:21.433544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 741/1482] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:32:23.851433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034a1d-da40-439d-9fc5-d5afd35ea652 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:23.852055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034a1d-da40-439d-9fc5-d5afd35ea652 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:23.852055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034a1d-da40-439d-9fc5-d5afd35ea652 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:23.853827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 742/1483] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:23.860487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b6a4-8aa2-4f04-8ec5-7bc00bbb3e54 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:23.861086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b6a4-8aa2-4f04-8ec5-7bc00bbb3e54 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:23.861086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b6a4-8aa2-4f04-8ec5-7bc00bbb3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:23.884446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6436b6a4-8aa2-4f04-8ec5-7bc00bbb3e54 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:23.885851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6436b6a4-8aa2-4f04-8ec5-7bc00bbb3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:23.896100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 742/1484] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:23.934593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034a1d-da40-439d-9fc5-d5afd35ea652 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:23.947799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034a1d-da40-439d-9fc5-d5afd35ea652 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:23.952076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:23.952726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:23.953046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:23.953373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:23.965648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:23.967184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640808-701e-4afd-8b0f-5c5089c75b4f service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:23.977319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 743/1485] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:32:26.256908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6874-cf11-43e0-a030-ca3b73dab611 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:26.257503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6874-cf11-43e0-a030-ca3b73dab611 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:26.257503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae6874-cf11-43e0-a030-ca3b73dab611 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:26.259278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 743/1486] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:26.264919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf019c-8ec5-4002-ac5c-21b59516a700 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:26.265431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf019c-8ec5-4002-ac5c-21b59516a700 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:26.265568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf019c-8ec5-4002-ac5c-21b59516a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:26.285073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1cdf019c-8ec5-4002-ac5c-21b59516a700 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:26.286296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1cdf019c-8ec5-4002-ac5c-21b59516a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:26.296013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 744/1487] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:26.334569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae6874-cf11-43e0-a030-ca3b73dab611 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:26.345856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae6874-cf11-43e0-a030-ca3b73dab611 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:26.349758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:26.350401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:26.350689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:26.350983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:26.361206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:26.362569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd32073-704e-4c96-a620-fdad14f90253 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:26.373624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 744/1488] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:32:28.758154 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ffb8-0860-493f-a110-1352ab104a2f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:28.758778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ffb8-0860-493f-a110-1352ab104a2f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:28.758778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ffb8-0860-493f-a110-1352ab104a2f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:28.760560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 745/1489] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:28.766836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e418f-e18e-4dc5-81c7-8fc8b67ace35 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:28.767360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e418f-e18e-4dc5-81c7-8fc8b67ace35 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:28.767360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e418f-e18e-4dc5-81c7-8fc8b67ace35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:28.787882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-dd2e418f-e18e-4dc5-81c7-8fc8b67ace35 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:28.789185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-dd2e418f-e18e-4dc5-81c7-8fc8b67ace35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:28.797819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 745/1490] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:28.847370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47ffb8-0860-493f-a110-1352ab104a2f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:28.858514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47ffb8-0860-493f-a110-1352ab104a2f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:28.862352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:28.863041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:28.863324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:28.863581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:28.874056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:28.875619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2c2a-fb42-4585-8f78-a0e810d6dda1 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:28.885914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 746/1491] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:32:31.321477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98679-e95f-4188-9946-2854bf22b139 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:31.322039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98679-e95f-4188-9946-2854bf22b139 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:31.322039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98679-e95f-4188-9946-2854bf22b139 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:31.323841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 746/1492] 10.222.0.32 () {54 vars in 926 bytes} [Thu Feb 10 03:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:32:31.329416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd00f-2d79-4422-aed3-e9f9d442d6e4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:31.329918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd00f-2d79-4422-aed3-e9f9d442d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:31.330022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd00f-2d79-4422-aed3-e9f9d442d6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:31.348964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8cbcd00f-2d79-4422-aed3-e9f9d442d6e4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:32:31.350173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8cbcd00f-2d79-4422-aed3-e9f9d442d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:32:31.358479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 747/1493] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Feb 10 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:32:31.397270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98679-e95f-4188-9946-2854bf22b139 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:32:31.408729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98679-e95f-4188-9946-2854bf22b139 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:32:31.412610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:32:31.413243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:32:31.413522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:32:31.413787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:32:31.423225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:32:31.424663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029d49-0a5e-4562-a628-1b9d0ecdf6d8 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:32:31.434196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 747/1494] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:33:46.801633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:46.802273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:46.802273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:46.821947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:33:46.823241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:46.835665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 748/1495] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:33:46.846389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:46.846970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:46.846970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:46.867001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:33:46.868219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:46.877950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 748/1496] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:33:46.883088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:46.893259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ec899-9896-4b6d-8250-edcada3a6e55 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:46.898723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:46.899389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:46.899663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:46.899935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:46.900658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:33:46.900959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:46.902557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:46.916445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 749/1497] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:33:46.924961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:46.934377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939da854-2cb5-4d7c-817e-4993334fc4b3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:46.939390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:46.940053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:46.940334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:46.940608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:46.941346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:46.943310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:46.982672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 749/1498] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:33:46 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:33:46.987461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.002644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c59d9-472c-474d-a4c2-5a1fac310cf1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.063605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.064290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.064564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.064856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.065603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.067604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.089987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 750/1499] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:33:46 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:33:47.095112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.106150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8202e-4683-402e-af5f-3217ac3e3b84 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.111998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.112686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.112965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.113229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.113968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.115640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.134464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 750/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:33:47.138882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.149709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0798-cfca-4973-96fa-98068bc7f625 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.155306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.155995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.156278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.156548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.157313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.158942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a935f25-8a0e-4d04-a60d-4d5fa282255d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.173509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 751/1501] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:33:47.178220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.189459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a21db-344b-40f4-8f0a-b6ec613487de admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.195618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.196517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.196797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.197065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] PATH_INFO: `/v3/projects/ab97d002ee1b4837bd2f73583b4fc821/users/d97aae26fb484035b84570b66c519eca/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.213731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab97d002ee1b4837bd2f73583b4fc821, user_id=d97aae26fb484035b84570b66c519eca, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.216465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.235171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 751/1502] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:33:47 2022] PUT /identity/v3/projects/ab97d002ee1b4837bd2f73583b4fc821/users/d97aae26fb484035b84570b66c519eca/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:33:47.248196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a30d9-0b04-4795-b88d-392f8d8e5d5f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.248477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a30d9-0b04-4795-b88d-392f8d8e5d5f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.248755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a30d9-0b04-4795-b88d-392f8d8e5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.283505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7f1a30d9-0b04-4795-b88d-392f8d8e5d5f None None] MFA Rules not processed for user `d97aae26fb484035b84570b66c519eca`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:33:47.285216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7f1a30d9-0b04-4795-b88d-392f8d8e5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:47.363106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 752/1503] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:33:47.375165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.445323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbe919-5924-4c88-999e-2f516606df1f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.451012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.451746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.452033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.452335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.461029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.462639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.471841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 752/1504] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:33:47.541736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964edb0-32ed-4297-93e0-07f34a183d98 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.542023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964edb0-32ed-4297-93e0-07f34a183d98 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.542296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964edb0-32ed-4297-93e0-07f34a183d98 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.544048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 753/1505] 10.222.0.32 () {52 vars in 829 bytes} [Thu Feb 10 03:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:33:47.548319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.612392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21bde-a434-4a9d-a469-2498933c3ed3 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.618158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.619083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.619355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.619620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] PATH_INFO: `/v3/users/d97aae26fb484035b84570b66c519eca` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.621025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97aae26fb484035b84570b66c519eca)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.622062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:33:47.622062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:33:47.622062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:33:47.623783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.692220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97aae26fb484035b84570b66c519eca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:47.706633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97aae26fb484035b84570b66c519eca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:47.726295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97aae26fb484035b84570b66c519eca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:47.727271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97aae26fb484035b84570b66c519eca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:47.737694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97aae26fb484035b84570b66c519eca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:47.744273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 753/1506] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:33:47 2022] DELETE /identity/v3/users/d97aae26fb484035b84570b66c519eca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:33:47.749342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.749627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.749901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.768646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:33:47.769997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:47.834716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 754/1507] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:33:47.845844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:47.847321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:47.905786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4345-e09c-4f83-a039-4c2c5cc9acf9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:47.909514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:47.910180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:47.910459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:47.910763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:47.920625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:47.922393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee24cf-2cac-458b-bc53-265869f1c206 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:47.933015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 754/1508] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:33:48.303669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:33:48.305308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:33:48.317459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526acb-aaf4-4e72-9054-3c6b9a90bf21 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:33:48.323704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:33:48.324674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:33:48.324944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:33:48.325233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] PATH_INFO: `/v3/projects/ab97d002ee1b4837bd2f73583b4fc821` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:33:48.326689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab97d002ee1b4837bd2f73583b4fc821)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:33:48.329822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:33:48.329822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:33:48.329822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:33:48.329822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:33:48.407293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab97d002ee1b4837bd2f73583b4fc821', 'request_id': 'req-6ef3952b-13f6-4827-a168-470eea211a71'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:48.414062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab97d002ee1b4837bd2f73583b4fc821', 'request_id': 'req-6ef3952b-13f6-4827-a168-470eea211a71'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:48.426761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab97d002ee1b4837bd2f73583b4fc821', 'request_id': 'req-6ef3952b-13f6-4827-a168-470eea211a71'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:48.448093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] The token cache is being invalidate because project ab97d002ee1b4837bd2f73583b4fc821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:33:48.448400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:48.449256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6ef3952b-13f6-4827-a168-470eea211a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:33:48.451329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 755/1509] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:33:48 2022] DELETE /identity/v3/projects/ab97d002ee1b4837bd2f73583b4fc821 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:35:14.924781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:14.925712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:14.925712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:14.928415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 755/1510] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:35:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:14.935872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35e6f-0b16-462d-8ce2-dfc72be4c718 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:14.936310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35e6f-0b16-462d-8ce2-dfc72be4c718 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:14.936512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35e6f-0b16-462d-8ce2-dfc72be4c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:14.964343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-9dd35e6f-0b16-462d-8ce2-dfc72be4c718 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:14.965576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9dd35e6f-0b16-462d-8ce2-dfc72be4c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:15.029660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 756/1511] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:15.185722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:15.187702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:15.268162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcdb9-9fdd-468b-be1a-f6f28903ffdc None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:15.274969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:15.275951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:15.276442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:15.276776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:15.289690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:15.292256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489552aa-d0b1-4a77-96c5-3fa0827d27d6 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:15.302036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 756/1512] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:15.504981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cf63e-83dc-4b1d-8066-80b3bb241612 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:15.505211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cf63e-83dc-4b1d-8066-80b3bb241612 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:15.505448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cf63e-83dc-4b1d-8066-80b3bb241612 None None] PATH_INFO: `/v3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:15.506795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 757/1513] 10.222.0.21 () {54 vars in 925 bytes} [Thu Feb 10 03:35:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:35:15.514287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3bc1-82ff-45de-b33f-e382339c6718 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:15.514573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3bc1-82ff-45de-b33f-e382339c6718 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:15.514871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3bc1-82ff-45de-b33f-e382339c6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:15.534052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-5daf3bc1-82ff-45de-b33f-e382339c6718 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:15.535298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5daf3bc1-82ff-45de-b33f-e382339c6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:15.598275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 757/1514] 10.222.0.21 () {58 vars in 1015 bytes} [Thu Feb 10 03:35:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:16.591153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0753-0c90-4892-aec4-3dee3ce67244 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:16.591794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0753-0c90-4892-aec4-3dee3ce67244 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:16.591794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0753-0c90-4892-aec4-3dee3ce67244 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:16.594153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 758/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:35:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:16.599802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61cc50-2522-4ba1-9bf4-ebad1acb73da None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:16.600239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61cc50-2522-4ba1-9bf4-ebad1acb73da None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:16.600348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61cc50-2522-4ba1-9bf4-ebad1acb73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:16.618970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-3f61cc50-2522-4ba1-9bf4-ebad1acb73da None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:16.620167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3f61cc50-2522-4ba1-9bf4-ebad1acb73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:16.628452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 758/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:16.786287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0753-0c90-4892-aec4-3dee3ce67244 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:16.802183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0753-0c90-4892-aec4-3dee3ce67244 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:16.808467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:16.809116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:16.809390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:16.809655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:16.818379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:16.820018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d0ac3-91e5-4124-9beb-7876afd8b3c8 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:16.831745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 759/1517] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:24.530468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca64a3-03b1-4ed4-9ff5-df46cc34f0d2 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:24.531182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca64a3-03b1-4ed4-9ff5-df46cc34f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:24.531182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca64a3-03b1-4ed4-9ff5-df46cc34f0d2 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:24.533147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 759/1518] 10.222.0.32 () {54 vars in 960 bytes} [Thu Feb 10 03:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:24.539670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273981-4a4b-446c-86d2-bb409f9afb76 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:24.540414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273981-4a4b-446c-86d2-bb409f9afb76 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:24.540594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273981-4a4b-446c-86d2-bb409f9afb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:24.563286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a3273981-4a4b-446c-86d2-bb409f9afb76 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:24.564504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a3273981-4a4b-446c-86d2-bb409f9afb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:24.575182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 760/1519] 10.222.0.32 () {58 vars in 1057 bytes} [Thu Feb 10 03:35:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:24.583052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca64a3-03b1-4ed4-9ff5-df46cc34f0d2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:24.597860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca64a3-03b1-4ed4-9ff5-df46cc34f0d2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:24.603858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:24.604502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:24.604780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:24.605072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:24.614529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:24.616219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016404-0083-4ee1-ab32-e6b5f8572eea service placement] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:24.626823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 760/1520] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:28.572691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ac33-04fb-40b5-a7a3-ce8dd9616348 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:28.573620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ac33-04fb-40b5-a7a3-ce8dd9616348 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:28.573620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ac33-04fb-40b5-a7a3-ce8dd9616348 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:28.576451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 761/1521] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:35:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:28.582744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a727e-b3f7-4b8e-83b5-3a14982ba37b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:28.583208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a727e-b3f7-4b8e-83b5-3a14982ba37b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:28.583303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a727e-b3f7-4b8e-83b5-3a14982ba37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:28.607620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e25a727e-b3f7-4b8e-83b5-3a14982ba37b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:28.608811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e25a727e-b3f7-4b8e-83b5-3a14982ba37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:28.617602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 761/1522] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:35:28.784601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1ac33-04fb-40b5-a7a3-ce8dd9616348 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:28.800494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1ac33-04fb-40b5-a7a3-ce8dd9616348 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:28.809411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:28.810406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:28.811034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:28.811397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:28.822586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:28.825112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294a43-05be-437c-9d2b-077a9ec95b81 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:28.836962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 762/1523] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:35:30.109474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c594-bcdc-4d27-9ff6-d9dd7cdd712e None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:30.110078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c594-bcdc-4d27-9ff6-d9dd7cdd712e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:30.110078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c594-bcdc-4d27-9ff6-d9dd7cdd712e None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:30.111926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 762/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Feb 10 03:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:30.119315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57d57-4e52-4c12-b9cf-3f9afacc47bd None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:30.119795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57d57-4e52-4c12-b9cf-3f9afacc47bd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:30.119917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57d57-4e52-4c12-b9cf-3f9afacc47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:30.142272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a7b57d57-4e52-4c12-b9cf-3f9afacc47bd None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:30.143522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a7b57d57-4e52-4c12-b9cf-3f9afacc47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:30.152144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 763/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Feb 10 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:30.305434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c594-bcdc-4d27-9ff6-d9dd7cdd712e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:30.323846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c594-bcdc-4d27-9ff6-d9dd7cdd712e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:30.329570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:30.330211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:30.330487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:30.330795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:30.339501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:30.341105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91b8d2-4b03-48d6-94dd-72c07bfcbd84 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:30.350842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 763/1526] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:34.413874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:34.414810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:34.414810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:34.417739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 764/1527] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:35:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:34.424092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39383e2-8856-4a32-9e16-05ca2a22260a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:34.424548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39383e2-8856-4a32-9e16-05ca2a22260a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:34.424681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39383e2-8856-4a32-9e16-05ca2a22260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:34.444141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d39383e2-8856-4a32-9e16-05ca2a22260a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:34.445337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d39383e2-8856-4a32-9e16-05ca2a22260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:34.455156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 764/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:34.495928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:34.500203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:34.574809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f57e0-ea36-4c88-8dd5-86f6cd9f4e37 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:34.579176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:34.579834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:34.580133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:34.580409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:34.589698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:34.591204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630960d-98fe-4dde-8357-d78239c9bc52 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:34.600511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 765/1529] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:36.825454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:36.826048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:36.826048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:36.828824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 765/1530] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:36.835199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2e6e-86b3-4b30-913a-97fa52e718f7 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:36.835616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2e6e-86b3-4b30-913a-97fa52e718f7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:36.835739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2e6e-86b3-4b30-913a-97fa52e718f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:36.858587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c7ac2e6e-86b3-4b30-913a-97fa52e718f7 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:36.859821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c7ac2e6e-86b3-4b30-913a-97fa52e718f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:36.869005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 766/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:36.905289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:36.907956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:36.924403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ecde5-3a4f-4818-af57-886c24383b96 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:36.929551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:36.930199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:36.930478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:36.930809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:36.941910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:36.943402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042728de-f955-4dc1-ab2c-f23b4cc05cd6 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:36.953228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 766/1532] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:40.669134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:40.669785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:40.669785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:40.671530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 767/1533] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:40.677650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423124-5d3e-4983-944c-a5c4de5ce637 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:40.678107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423124-5d3e-4983-944c-a5c4de5ce637 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:40.678220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423124-5d3e-4983-944c-a5c4de5ce637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:40.697689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a6423124-5d3e-4983-944c-a5c4de5ce637 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:40.698906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a6423124-5d3e-4983-944c-a5c4de5ce637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:40.708031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 767/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:40.958095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:40.961129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:41.032663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453b30-fc2f-4309-8293-480d1f52842e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:41.037027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:41.037693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:41.037970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:41.038243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:41.047534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:41.048987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18829ee-7c5a-470d-99bb-69861af9e9d2 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:41.058583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 768/1535] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:35:43.338160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c720a7-5a45-43c1-a346-9140057de39b None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:43.338802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c720a7-5a45-43c1-a346-9140057de39b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:43.338802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c720a7-5a45-43c1-a346-9140057de39b None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:43.340566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 768/1536] 127.0.0.1 () {54 vars in 916 bytes} [Thu Feb 10 03:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:43.349297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75a4f-87f3-4b4f-a3f8-508e5730d850 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:43.349994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75a4f-87f3-4b4f-a3f8-508e5730d850 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:43.350205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b75a4f-87f3-4b4f-a3f8-508e5730d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:43.374464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-87b75a4f-87f3-4b4f-a3f8-508e5730d850 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:43.375709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-87b75a4f-87f3-4b4f-a3f8-508e5730d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:43.385692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 769/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Feb 10 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:43.638308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ae69-8438-47ce-bf8d-5938529facb9 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:43.638578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ae69-8438-47ce-bf8d-5938529facb9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:43.638874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ae69-8438-47ce-bf8d-5938529facb9 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:43.640647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 769/1538] 10.222.0.32 () {54 vars in 963 bytes} [Thu Feb 10 03:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:35:43.647065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8836f0-cd7a-46cd-9a97-ead3c5e69f67 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:43.647350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8836f0-cd7a-46cd-9a97-ead3c5e69f67 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:43.647628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8836f0-cd7a-46cd-9a97-ead3c5e69f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:43.667486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-9c8836f0-cd7a-46cd-9a97-ead3c5e69f67 None None] MFA Rules not processed for user `87ef495cf58846848130382884d739e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:35:43.668723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9c8836f0-cd7a-46cd-9a97-ead3c5e69f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:35:43.676483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 770/1539] 10.222.0.32 () {58 vars in 1060 bytes} [Thu Feb 10 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:35:43.684511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828ae69-8438-47ce-bf8d-5938529facb9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:35:43.696929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828ae69-8438-47ce-bf8d-5938529facb9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:35:43.702122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:35:43.702811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:35:43.703092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:35:43.703357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:35:43.713401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:35:43.714887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68647-7de4-4346-9d3f-78b058422cd3 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:35:43.724685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 770/1540] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:03.438502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.439716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.440249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.467950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.469173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.477916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 771/1541] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.486865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.487510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.487510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.507173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.508433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.521389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 771/1542] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.526378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:03.536997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d55df-a285-4ee5-8812-973d1bb60f03 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:03.543868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:03.544554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.544835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.545109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.545868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:03.546182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:03.547832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8baeb-dfb1-4fa0-856e-41b6f571d6c6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:03.560970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 772/1543] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:03.569535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:03.579711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f49f4-db4e-455d-a354-95fd50bc0be0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:03.587089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:03.587764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.588043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.588315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.589035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:03.591108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883401-c56f-4ebc-becb-2bf57416a191 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.591390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883401-c56f-4ebc-becb-2bf57416a191 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.591663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883401-c56f-4ebc-becb-2bf57416a191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.593257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9782fa9-c2e6-4a7c-a24f-9e7c3312a3c1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:03.630918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6b883401-c56f-4ebc-becb-2bf57416a191 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.632627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6b883401-c56f-4ebc-becb-2bf57416a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.644263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 773/1544] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Feb 10 03:37:03.645516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.645804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.646077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.659513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 772/1545] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:03.660960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8b32-d6b4-447f-80d6-c6d288006166 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.661262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8b32-d6b4-447f-80d6-c6d288006166 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.661528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd8b32-d6b4-447f-80d6-c6d288006166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.689733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.691444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.714675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a6dd8b32-d6b4-447f-80d6-c6d288006166 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.714675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a6dd8b32-d6b4-447f-80d6-c6d288006166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.771746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 774/1546] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.772517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:03.780951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 773/1547] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.782258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588169-a327-45d4-af02-b0d8f217cc07 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.782542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588169-a327-45d4-af02-b0d8f217cc07 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.782900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0588169-a327-45d4-af02-b0d8f217cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.784162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adc004-6dca-44c5-951d-de6905fd2feb None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:03.788587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:03.789312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.789592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.789868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.790572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:03.792533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41844a-b666-45fd-bffd-fbc308b18325 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:03.800437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e0588169-a327-45d4-af02-b0d8f217cc07 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.801633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e0588169-a327-45d4-af02-b0d8f217cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.810422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 774/1548] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.811723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebd07-03b0-4df1-b665-eed6ae2d381b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.812012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebd07-03b0-4df1-b665-eed6ae2d381b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.812287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebd07-03b0-4df1-b665-eed6ae2d381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.814615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 775/1549] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:03.816107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c94ce-9e14-4e05-b6b8-50a59ffff092 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.816391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c94ce-9e14-4e05-b6b8-50a59ffff092 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.816668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c94ce-9e14-4e05-b6b8-50a59ffff092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.833666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b41ebd07-03b0-4df1-b665-eed6ae2d381b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.834430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fd5c94ce-9e14-4e05-b6b8-50a59ffff092 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.834866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b41ebd07-03b0-4df1-b665-eed6ae2d381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.835615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fd5c94ce-9e14-4e05-b6b8-50a59ffff092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.843898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 775/1550] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.844725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 776/1551] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.845837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8a21-dcb1-443d-8748-ad3166f3b807 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.846129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8a21-dcb1-443d-8748-ad3166f3b807 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.846404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8a21-dcb1-443d-8748-ad3166f3b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.847251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.847949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.849411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.864582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-012b8a21-dcb1-443d-8748-ad3166f3b807 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.865789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-012b8a21-dcb1-443d-8748-ad3166f3b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.867910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.869083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.874186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 777/1552] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.875438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3a896-3462-453a-9bea-596b87adda77 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.875729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3a896-3462-453a-9bea-596b87adda77 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.876008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3a896-3462-453a-9bea-596b87adda77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.877410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 776/1553] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.878329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:03.893819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea35e9-8c62-4fca-99f2-0f4b661e96c9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:03.898950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:03.899692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.899961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.900176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.900837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fab3a896-3462-453a-9bea-596b87adda77 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.901034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:03.901350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:03.902038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fab3a896-3462-453a-9bea-596b87adda77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.903344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:03.910004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 778/1554] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.914135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d03d-ea88-4ae3-b30f-44959c0913e3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.914135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d03d-ea88-4ae3-b30f-44959c0913e3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.914135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d03d-ea88-4ae3-b30f-44959c0913e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.920567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 777/1555] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:03.921994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:03.930902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3871d03d-ea88-4ae3-b30f-44959c0913e3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.932071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3871d03d-ea88-4ae3-b30f-44959c0913e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.939138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c45d79-4701-4787-8196-699c2d561373 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:03.940003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 779/1556] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.941333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65d3d-3747-4f23-b369-5a04491dc492 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.941639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65d3d-3747-4f23-b369-5a04491dc492 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.941876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65d3d-3747-4f23-b369-5a04491dc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.944987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:03.945662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.945943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.946266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.947056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:03.948725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1304b3b-2d6d-4820-a199-6e97ecd2d3d3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:03.959358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 778/1557] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:03.960686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ca18-a4a5-4abf-85c7-04e5e6a504a1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.960921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ca18-a4a5-4abf-85c7-04e5e6a504a1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.961246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ca18-a4a5-4abf-85c7-04e5e6a504a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.963529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4db65d3d-3747-4f23-b369-5a04491dc492 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.964815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4db65d3d-3747-4f23-b369-5a04491dc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.973064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 780/1558] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.974432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.974747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.975025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.982389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2d95ca18-a4a5-4abf-85c7-04e5e6a504a1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.983617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2d95ca18-a4a5-4abf-85c7-04e5e6a504a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:03.991537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 779/1559] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:03.992814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:03.992953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:03.993146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:03.993358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:03.993945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:04.002371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 781/1560] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:04.003261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.012078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:04.012755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba786baf-1b03-4a2b-a1f4-35f8727abab0 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.013280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:04.017612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.018258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.018544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.018862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.019603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.019908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.021524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.022263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 780/1561] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:04.022837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.032061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4e4de-397a-4539-bfc1-3050fa2ac98c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.036044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 782/1562] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.036982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.037117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.037798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.038104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.038399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.039209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.041108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.046436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427edcdf-d37f-4fdb-b335-b35666c10da4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.050891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.051546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.051829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.052101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.052825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.053128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.054781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.066681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 783/1563] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.067369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 781/1564] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.068292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.070917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.080432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dadf0d-0559-472c-b996-e55ee14173e3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.131915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735f1c-7c3f-4d33-9058-3c9e1a868957 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.136704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.137376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.137659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.137995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.138344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.138739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.138996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.139111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.139315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.139792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.140500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.140641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.142128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.152266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 784/1565] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.152438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 782/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.152913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.153018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.162766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511a40-43e6-4cac-aa21-3b968e96c619 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.163071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7e52-0896-4f15-8e99-20ba2d7816b8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.167793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.167996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.168456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.168607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.168716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.168805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.168968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.169087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.169730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.169826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.170036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.170149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.171666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.171795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.184296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 783/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.185216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.186810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 785/1568] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.187858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.195178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ecf5-c276-4a3b-95a1-5faeff435fdc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.200244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.200913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.201149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d4c3-5d08-499a-ae95-1279c9540574 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.201257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.201431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.202165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:04.202473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.204125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.205875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.206584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.206959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.207296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.208045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.210242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.215537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 784/1569] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:04.216313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.226038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4091-d65d-4969-b2a1-edb9e1fa368b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.230902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.231701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.231995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.232256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.232958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.234887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.236696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 786/1570] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.237500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.259936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 785/1571] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.259936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.266811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abc2c9-40eb-40e6-a34f-c52376381931 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.300226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb982-2578-4946-884f-514f88080dff admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.305176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.305931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.306138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.306579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.307134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.309038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.322185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.323190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.323583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.323880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] PATH_INFO: `/v3/projects/6b920505d820478983cef9ecfae1df55/users/6bf5e2dd7f0c467aa68a85f1833803bb/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.334748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 787/1572] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.335550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.339266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b920505d820478983cef9ecfae1df55, user_id=6bf5e2dd7f0c467aa68a85f1833803bb, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.341912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.355722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 786/1573] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:04 2022] PUT /identity/v3/projects/6b920505d820478983cef9ecfae1df55/users/6bf5e2dd7f0c467aa68a85f1833803bb/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:04.356582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.415339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348deb-81bc-4ee6-b241-91107ff7e389 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.420071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.420739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.421018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.421290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.421592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57f72b-ee48-451c-b9b6-037c3a0bbcb8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.421989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.423925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.426414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.427107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.427414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.427687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.428505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.430574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.450845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 788/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.452315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.456778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 787/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.457910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.512499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd6b4d-51b7-46b5-90d2-a28bd2beda50 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.517175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.517851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.518136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.518413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.518960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc9fd-6234-4007-ae33-dfab780996c9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.519478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.521085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.523844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.524535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.524949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.525267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.525952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.527955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.549004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 789/1576] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.550120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.560170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 788/1577] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.560170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.611721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceffb4b-67b5-4c29-ac50-af028964448c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.616423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.617125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.617440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.617544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626a40-a1df-4975-9cbd-66320570406e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.617714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.618416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.620376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8a2c-c5f2-43dc-b052-46205ffb4fdf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.623922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.624631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.624975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.625236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.626035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.627682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.641158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 789/1578] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.641158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.644208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 790/1579] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.645646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.645995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.646332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.652058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b09c-266a-44b7-b9af-2754d49072a1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.657562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.658228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.658502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.658792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.659496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.661419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.673055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] MFA Rules not processed for user `6bf5e2dd7f0c467aa68a85f1833803bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:04.674270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:04.682578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 790/1580] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.683626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.693597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1744b-2550-4186-9a9b-af14ab6209d1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.698296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.699027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.699334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.699864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.700385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.702447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.724586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 791/1581] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.725385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.735532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef20f4-de9f-40d2-99d1-9838f66f43bd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.740170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 791/1582] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:04.741018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.745647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.746314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.746586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.747399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.748019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.749925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.756496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc26e-49da-4ad1-8142-fa4584a74320 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.762594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.763374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.763666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.763947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.764691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.766714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.773587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 792/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.774571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.786310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb43ad-fea3-42fa-8ee3-73078ba53049 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.787715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 792/1584] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.788433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.792007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.792821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.793200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.793467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.794175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.796150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.797911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae40e-52e0-4735-9b44-7464f3adb4e9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.802860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.803528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.803812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.804088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.804892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.806947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.816290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 793/1585] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:04.817032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.818082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 793/1586] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.821882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.826318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c67ff0-8c08-485e-b879-dbd9233136f2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.831219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.831399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214d69-4086-4a88-a33a-786169f928e1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.831847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.832120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.832385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.833113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.834743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.836455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.837985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.838277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.838554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.839398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.841290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3fe83-2d87-44f3-9d6e-cdfac6376374 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.844942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 794/1587] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.845725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.852247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 794/1588] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.853564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7612-d93a-4c57-b022-4b402bdc6096 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.853843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7612-d93a-4c57-b022-4b402bdc6096 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.854112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7612-d93a-4c57-b022-4b402bdc6096 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.855986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 795/1589] 10.222.0.32 () {54 vars in 961 bytes} [Thu Feb 10 03:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:04.856677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a7612-d93a-4c57-b022-4b402bdc6096 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.859394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4da4-6225-4dad-9608-903bd11d24fe admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.864524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.865197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.865473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.865739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.866530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.868169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.868540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a7612-d93a-4c57-b022-4b402bdc6096 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.873350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.873978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.874254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.874517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.875303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.876884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.878964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 795/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.879946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.887538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 796/1591] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.889697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e26e2-786d-4ef9-9fba-e10cdca3a2c4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.891366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.894327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.895012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.895295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.895567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.896304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.897956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.900718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd89f1-4413-4f43-832f-55ffb82ca8b4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.905602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.906267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.906588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.906914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.907650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.908058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 796/1592] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.908826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.909449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.919858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 797/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.920685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.922057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6347fa-90de-4a8b-afcb-01d0cf0a3192 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.926508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.927435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.927713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.927983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] PATH_INFO: `/v3/projects/50e1249fa4204bf9ba3044c3c1260634/users/d637094d14264332b6a947fe1e5c0ad8/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.931295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33e7a4-3670-4ac0-96c9-05cb7daa64f9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.935865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:04.936528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.936812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.937087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.937824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.939468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.942433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1249fa4204bf9ba3044c3c1260634, user_id=d637094d14264332b6a947fe1e5c0ad8, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:04.945129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa1e02-dd19-4fec-a53e-61d7b81afbfc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:04.950044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 798/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:04.950949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:04.959925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 797/1595] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:04 2022] PUT /identity/v3/projects/50e1249fa4204bf9ba3044c3c1260634/users/d637094d14264332b6a947fe1e5c0ad8/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:04.960699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ff3c0-197a-457f-973f-ca33121d77bf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:04.961695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:04.962183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:04.962606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:04.980164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:04.981587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.022171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.022874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.023175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.023502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.024200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.025821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.036797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 799/1596] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:05.037606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.047063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05029b5-3ac9-4d30-828e-29ab7a68e37f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.052404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.053054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.053335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.053603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.054004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 798/1597] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Feb 10 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.054328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.055294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.056232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.065349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6881-6af0-47e8-91c5-c10a69a1e244 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.066530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 800/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:05.067297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.070411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.070926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.071204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.071471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.072239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.073852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.077452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274db9b-ccf7-442f-8793-5cd074d381c3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.082314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.083004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.083286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.083558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.083873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 799/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:05.084848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.087580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.089222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.094789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc80-bd1a-4783-9d21-727bd64a91d5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.100125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.100463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 801/1600] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:05.100766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.101037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.101215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.101419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.102082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.103846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c20410-c813-40c8-9168-a6182335da0b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.110944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e5832-e041-471b-85d0-1c4eee6b5538 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.116744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 800/1601] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:05.116744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.116744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.117059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.117207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.117286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.117286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.117286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] PATH_INFO: `/v3/projects/b1ad4b9bfe7941d3baa9c36cf551a874/users/003425f2d3474769b4f996f680088f94/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.132744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.133069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ad4b9bfe7941d3baa9c36cf551a874, user_id=003425f2d3474769b4f996f680088f94, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.133923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.135777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.141575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 801/1602] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.142343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.153853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 802/1603] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/b1ad4b9bfe7941d3baa9c36cf551a874/users/003425f2d3474769b4f996f680088f94/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.154695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.155581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feff8ed-8cfe-46d1-b46b-de6ae2491e41 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.209944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.210959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.211245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.211498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] PATH_INFO: `/v3/projects/defc94e1dbd94cbc896a8c42ba6ddda3/users/523f67bc2d8f4f7298dc6b7d1fd09515/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.221046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bbcb-33a8-4c05-8a52-e701de80d24e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.225761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=defc94e1dbd94cbc896a8c42ba6ddda3, user_id=523f67bc2d8f4f7298dc6b7d1fd09515, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.226541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.227231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.227513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.227788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.228758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.244143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 802/1604] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/defc94e1dbd94cbc896a8c42ba6ddda3/users/523f67bc2d8f4f7298dc6b7d1fd09515/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.245212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.293598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.295362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.305494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 803/1605] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:05.306447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.316016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8087-1e49-4ccf-8701-70040fe9c8b4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.316930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a26bbf-246d-4c06-8fba-89474ca34a84 service nova] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.320777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.321754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.322116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.322319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.322499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] PATH_INFO: `/v3/projects/6ce6424c3d084b128a81594bd2862f54/users/18c5fda004b744f9b2c3a73bb090f05d/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.323378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.323724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.324064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] PATH_INFO: `/v3/projects/f327fcae4b024948a911ad1bdeb06ad9/users/fc1ef6f6170f4ccb9e3b439ac3fd56e0/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.338115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce6424c3d084b128a81594bd2862f54, user_id=18c5fda004b744f9b2c3a73bb090f05d, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.339448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f327fcae4b024948a911ad1bdeb06ad9, user_id=fc1ef6f6170f4ccb9e3b439ac3fd56e0, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.340933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.342242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.356045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 803/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/6ce6424c3d084b128a81594bd2862f54/users/18c5fda004b744f9b2c3a73bb090f05d/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.357051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.357833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 804/1607] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/f327fcae4b024948a911ad1bdeb06ad9/users/fc1ef6f6170f4ccb9e3b439ac3fd56e0/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.359229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.424023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b421dc-0f5e-4c2d-a2d4-a5e76f52f485 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.428912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.430010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.430356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.430724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] PATH_INFO: `/v3/projects/2c945afda23742628c0c1945d26a5be5/users/ec1e8228ef0a4c448fd66689918e941f/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.431500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98db6a-c4dc-4965-9cb8-cd94f81e035f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.436097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.436994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.437283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.437557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] PATH_INFO: `/v3/projects/d7bf7bed71094487b57906e39d043543/users/5adf0f1d005d4a1eb0136d4593b094b5/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.447549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c945afda23742628c0c1945d26a5be5, user_id=ec1e8228ef0a4c448fd66689918e941f, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.450287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.451842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bf7bed71094487b57906e39d043543, user_id=5adf0f1d005d4a1eb0136d4593b094b5, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.454481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7e7b0-8c62-4989-abb8-8309f77530b8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.465146 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 804/1608] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/2c945afda23742628c0c1945d26a5be5/users/ec1e8228ef0a4c448fd66689918e941f/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.467603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.468463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 805/1609] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:05 2022] PUT /identity/v3/projects/d7bf7bed71094487b57906e39d043543/users/5adf0f1d005d4a1eb0136d4593b094b5/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:05.473285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096bff-6bd4-4e10-a994-c9de9f8ef3fb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.473572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096bff-6bd4-4e10-a994-c9de9f8ef3fb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.473854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096bff-6bd4-4e10-a994-c9de9f8ef3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.492583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ef096bff-6bd4-4e10-a994-c9de9f8ef3fb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.493838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ef096bff-6bd4-4e10-a994-c9de9f8ef3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.549527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920bc35-2c09-4fc5-89a8-c7d7b9a534ea admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.558272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 806/1610] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.559530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aba5-650d-4fde-ab73-92bf31d72b25 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.559895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aba5-650d-4fde-ab73-92bf31d72b25 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.560244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aba5-650d-4fde-ab73-92bf31d72b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.587250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-07e6aba5-650d-4fde-ab73-92bf31d72b25 None None] MFA Rules not processed for user `523f67bc2d8f4f7298dc6b7d1fd09515`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.588481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-07e6aba5-650d-4fde-ab73-92bf31d72b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.602180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.603056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.603363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.603637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.613395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.614622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b206b-fd59-4f81-8068-5c4928bdcbbb service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.625328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 805/1611] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:05.626804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45dca-a048-432e-9297-800e9f6b1d3b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.627036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45dca-a048-432e-9297-800e9f6b1d3b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.627315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c45dca-a048-432e-9297-800e9f6b1d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.645038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-72c45dca-a048-432e-9297-800e9f6b1d3b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.646360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-72c45dca-a048-432e-9297-800e9f6b1d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.656795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 806/1612] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.657668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 807/1613] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.658174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.658484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.658756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.659636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0a56-26f3-4351-8815-a30834c043d4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.663529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0a56-26f3-4351-8815-a30834c043d4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.664019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0a56-26f3-4351-8815-a30834c043d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.697255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4abc0a56-26f3-4351-8815-a30834c043d4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.698870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4abc0a56-26f3-4351-8815-a30834c043d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.703909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] MFA Rules not processed for user `18c5fda004b744f9b2c3a73bb090f05d`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.705700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.717776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 808/1614] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.728596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.729490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.729964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.770544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] MFA Rules not processed for user `ec1e8228ef0a4c448fd66689918e941f`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:05.771743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:05.779246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 807/1615] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.779246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.791582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531350-9ec5-4c02-a9c0-1fa68c3672e6 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.795662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.796527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.796946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.797316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.808555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.810245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.824416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 808/1616] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:05.825456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.838427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f591-ec96-45b2-b94f-42c01e72e15d service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.843270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.843859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.844142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.844413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.845119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:05.847077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:05.866567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 809/1617] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:05.867568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.878795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5717-b6d2-4ec0-bd50-327ed6dacc5c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.883521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 809/1618] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:05.883521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:05.930456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.931154 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.931781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.932070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:05.940237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab88853-d235-4002-9d10-236f3a3d7cbc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:05.945017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:05.945955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:05.946391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:05.946693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.010329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.013001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.016694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.018407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544aa7-86ee-4206-a08c-a0d654b1e415 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.026355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 810/1619] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:06.027464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.031266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 810/1620] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:06.033514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403360-dd41-4385-b828-5e5266677ac8 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.034001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403360-dd41-4385-b828-5e5266677ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.034389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403360-dd41-4385-b828-5e5266677ac8 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.036860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 811/1621] 10.222.0.32 () {54 vars in 961 bytes} [Thu Feb 10 03:37:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:06.037727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403360-dd41-4385-b828-5e5266677ac8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.044721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7e6f-3458-4f64-869c-c334c5939124 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.054576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.055456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.055906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.056494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.057360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.061828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.102553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403360-dd41-4385-b828-5e5266677ac8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.106988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 811/1622] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:06.107309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.107827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.108253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.108621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.108920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.174445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.187071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f96b-2d10-49ce-a8d0-ae158b845098 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.200667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f08-e7c9-4f35-b201-d2d6dbe6e446 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.208617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 812/1623] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:06.209053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.209996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.210401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.210697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.211993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.212722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.214365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.214805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.214923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.252178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 812/1624] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:06.252178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.258746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:06.260063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:06.261939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa5e07-c8ac-44ef-8339-266985515812 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.268194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.269020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.269354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.269630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.270418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.272613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.304753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 813/1625] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:06.306302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.319053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3ed9-772a-4432-a45e-604a77e25585 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.327853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.328783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.329341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.329623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.330483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.332213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.348008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 814/1626] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:06.349092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.361538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9470-9425-45da-a8e1-1fdcb61ef74f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.368918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.369703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.369993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.370309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.371193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.373834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.391330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 815/1627] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:06.392563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.392696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 813/1628] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:06.400409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.405405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904a9b6-3796-4a2e-8985-1de13d2d1cc8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.410577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.411829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.412151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.412384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] PATH_INFO: `/v3/projects/38182e2a2d19434b817bbceee0eb3c3c/users/3171fe4414f9449f9d783a6da0aebca1/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.428360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38182e2a2d19434b817bbceee0eb3c3c, user_id=3171fe4414f9449f9d783a6da0aebca1, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.431595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a168367-8bb9-4117-8c57-43259c680115 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.437929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40521d-42df-469f-9775-9f4e90945f54 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.447692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.448784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.449102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.449376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] PATH_INFO: `/v3/projects/4c31224eaee34362932f13752c39fcb2/users/eb383bcbfb154aaf85e889519201e98b/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.455935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 816/1629] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:06 2022] PUT /identity/v3/projects/38182e2a2d19434b817bbceee0eb3c3c/users/3171fe4414f9449f9d783a6da0aebca1/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:06.463353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0188c7-fbd1-4652-8be0-bdb3c53881eb None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.463634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0188c7-fbd1-4652-8be0-bdb3c53881eb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.464165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0188c7-fbd1-4652-8be0-bdb3c53881eb None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.465987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 817/1630] 10.222.0.32 () {54 vars in 912 bytes} [Thu Feb 10 03:37:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:06.466747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0188c7-fbd1-4652-8be0-bdb3c53881eb None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.475414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c31224eaee34362932f13752c39fcb2, user_id=eb383bcbfb154aaf85e889519201e98b, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.478585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea319f09-fbe1-4e6a-9130-ac32ec490849 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.500848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 814/1631] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:06 2022] PUT /identity/v3/projects/4c31224eaee34362932f13752c39fcb2/users/eb383bcbfb154aaf85e889519201e98b/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:06.502675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.503643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.503983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.559594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:06.560411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0188c7-fbd1-4652-8be0-bdb3c53881eb None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.560837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:06.670022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.670804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.671094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.671458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.672489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.674711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.702757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 818/1632] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:06.702757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.720771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fea5a2-8634-45ee-9786-32db27cf0597 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.736208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.736910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.737201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.737504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.739063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.739959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.741120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 815/1633] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:06.742234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.758490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 819/1634] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:06.759595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.779678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62931-79b7-482f-946f-4432ce98d739 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.793765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.796045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.798805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.798805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] PATH_INFO: `/v3/projects/38182e2a2d19434b817bbceee0eb3c3c/users/3171fe4414f9449f9d783a6da0aebca1/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.801385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38182e2a2d19434b817bbceee0eb3c3c, user_id=3171fe4414f9449f9d783a6da0aebca1, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.805823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.831842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 816/1635] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:06 2022] PUT /identity/v3/projects/38182e2a2d19434b817bbceee0eb3c3c/users/3171fe4414f9449f9d783a6da0aebca1/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:06.832848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:06.889512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695d67-4852-447e-88f4-5980f62665ca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.933946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab16af-1dd5-47a6-9609-c79e8a6265f1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:06.939470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:06.940729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.941009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.941282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] PATH_INFO: `/v3/projects/4c31224eaee34362932f13752c39fcb2/users/eb383bcbfb154aaf85e889519201e98b/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:06.943729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c31224eaee34362932f13752c39fcb2, user_id=eb383bcbfb154aaf85e889519201e98b, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:06.946536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83724e-4166-47a9-b771-b3cf1aceec60 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:06.965004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 817/1636] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:06 2022] PUT /identity/v3/projects/4c31224eaee34362932f13752c39fcb2/users/eb383bcbfb154aaf85e889519201e98b/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:06.979363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865b78-b531-4219-86ca-56ddc457664f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:06.979656 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865b78-b531-4219-86ca-56ddc457664f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:06.979985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865b78-b531-4219-86ca-56ddc457664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.003650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:07.004793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.005961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.006213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.108769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d5865b78-b531-4219-86ca-56ddc457664f None None] MFA Rules not processed for user `3171fe4414f9449f9d783a6da0aebca1`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:07.112407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d5865b78-b531-4219-86ca-56ddc457664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:07.186511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:07.188008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6cada-c2eb-427f-85ef-184c8010524a service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:07.210888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 820/1637] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:07.212317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.212637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.212970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.271787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] MFA Rules not processed for user `eb383bcbfb154aaf85e889519201e98b`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:07.274107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:07.285342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 818/1638] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:07.285342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339d985-ba58-4f5d-b456-d8949af853b9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.285342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339d985-ba58-4f5d-b456-d8949af853b9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.285342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339d985-ba58-4f5d-b456-d8949af853b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.392627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7339d985-ba58-4f5d-b456-d8949af853b9 None None] MFA Rules not processed for user `003425f2d3474769b4f996f680088f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:07.395201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7339d985-ba58-4f5d-b456-d8949af853b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:07.478850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 821/1639] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:07.484419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 819/1640] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b38fe-268a-41ba-bbbb-0663f5bb0aae None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b38fe-268a-41ba-bbbb-0663f5bb0aae None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b38fe-268a-41ba-bbbb-0663f5bb0aae None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 820/1641] 10.222.0.32 () {54 vars in 912 bytes} [Thu Feb 10 03:37:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:07.553902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b38fe-268a-41ba-bbbb-0663f5bb0aae None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:07.609060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2491e-2260-49ef-8da0-bc85bbbb219c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:07.615538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:07.616226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.616832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.617253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.641918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:07.643371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73612dd-085e-4722-a747-cdd13cd5cdd6 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:07.660825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 822/1642] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:07.662178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43298-1f3b-46e4-af9b-bfa83afdf290 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.663770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43298-1f3b-46e4-af9b-bfa83afdf290 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.665227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43298-1f3b-46e4-af9b-bfa83afdf290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.670115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b38fe-268a-41ba-bbbb-0663f5bb0aae None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:07.680111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:07.680865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.681286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.681664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.698867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2db43298-1f3b-46e4-af9b-bfa83afdf290 None None] MFA Rules not processed for user `003425f2d3474769b4f996f680088f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:07.700391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2db43298-1f3b-46e4-af9b-bfa83afdf290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:07.711327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:07.712808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:07.716463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 823/1643] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:07.717863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.718211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.718548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.745388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 821/1644] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:07.746460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:07.772043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:07.773452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:07.927340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 824/1645] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:07.928323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:07.931081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadca57-a59e-4816-a53c-90c74b7f25d5 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:07.943263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:07.943976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.944264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.944540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.954201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d488e-373e-4c61-b211-a1739fa2c868 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:07.959605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:07.960274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:07.960564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:07.960749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:07.960885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:07.963014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:07.995686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 822/1646] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:07.996810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:08.012586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f719e-ac67-4a8a-9bc1-bd96d2800ef1 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:08.018300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:08.019236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:08.019832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:08.020305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:08.033062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:08.038444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:08.057013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 823/1647] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:08.096456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:08.105191 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527760-e585-4d8c-9e8c-fb2c55528ff1 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:08.110823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:08.112308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:08.123513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:08.124819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:08.124819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:08.124819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:08.167900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 825/1648] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:08.287167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:08.292153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e85ce-720f-4d88-813d-199cd9b8e0b4 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:08.316188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 824/1649] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:08.575859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:08.685454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92314-3bc9-42d7-a950-ff7166c9f037 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:08.695476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:08.697029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:08.697777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:08.698779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] PATH_INFO: `/v3/users/6bf5e2dd7f0c467aa68a85f1833803bb` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:08.704954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf5e2dd7f0c467aa68a85f1833803bb)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:08.706156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: WARNING py.warnings [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:08.706156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: warnings.warn(msg) Feb 10 03:37:08.706156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: Feb 10 03:37:08.708110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:08.870529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf5e2dd7f0c467aa68a85f1833803bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:08.887499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf5e2dd7f0c467aa68a85f1833803bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:08.888306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf5e2dd7f0c467aa68a85f1833803bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:08.901401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf5e2dd7f0c467aa68a85f1833803bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:08.924402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf5e2dd7f0c467aa68a85f1833803bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:08.937495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222738-f29f-4fd2-9813-95c053b224e1 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:08.938076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222738-f29f-4fd2-9813-95c053b224e1 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:08.938076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222738-f29f-4fd2-9813-95c053b224e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:08.939592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 826/1650] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:08 2022] DELETE /identity/v3/users/6bf5e2dd7f0c467aa68a85f1833803bb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:08.956548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-90222738-f29f-4fd2-9813-95c053b224e1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:08.957763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-90222738-f29f-4fd2-9813-95c053b224e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.032998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 825/1651] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:09.049441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:09.051574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.188754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbdf1-fd0c-45cb-8bf9-a803ec098661 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:09.196223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:09.200755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.201097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.201381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.224305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:09.224765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152401b-d213-4353-8429-f74df0adef02 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.225069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152401b-d213-4353-8429-f74df0adef02 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.225380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152401b-d213-4353-8429-f74df0adef02 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.226740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253fe5e-41a0-415c-b3ca-b755162ac480 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:09.228021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 826/1652] 10.222.0.32 () {54 vars in 912 bytes} [Thu Feb 10 03:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:09.233658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.233948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.234212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.273037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 827/1653] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:09.337886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.338211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.338500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.362281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:09.363530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.376173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] MFA Rules not processed for user `5adf0f1d005d4a1eb0136d4593b094b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:09.377478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.384992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 827/1654] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:09.409933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:09.418923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4689b5-0c55-4fd8-a837-6d84fd5cd531 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:09.434445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:09.435144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.435427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.435702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.457269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:09.458841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b308b4-11e0-42f8-b8b8-56f9d188221f service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:09.467605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 828/1655] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:37:09.595911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 828/1656] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:09.607592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149e30-f248-473b-a28f-97ff2ebd8cb9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.608273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149e30-f248-473b-a28f-97ff2ebd8cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.608788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149e30-f248-473b-a28f-97ff2ebd8cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.634287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-3e149e30-f248-473b-a28f-97ff2ebd8cb9 None None] MFA Rules not processed for user `5adf0f1d005d4a1eb0136d4593b094b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:09.636916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3e149e30-f248-473b-a28f-97ff2ebd8cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.652729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 829/1657] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:09.663687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:09.668672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:09.813872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357389f7-eb26-44af-a3fd-77ea93dfd294 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:09.837942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:09.839963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:09.841209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:09.842520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:09.857863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:09.860155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c286ac-ebba-4c76-b652-2441149b6022 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:09.883977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 829/1658] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:10.902252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec18e-0503-4fd3-a936-173a0d033e1f None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:10.903157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec18e-0503-4fd3-a936-173a0d033e1f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:10.904152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec18e-0503-4fd3-a936-173a0d033e1f None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:10.906264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 830/1659] 10.222.0.32 () {54 vars in 912 bytes} [Thu Feb 10 03:37:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:10.913778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:10.915423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:10.915908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:10.973093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:10.978913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.017638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 830/1660] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:11.048222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ec18e-0503-4fd3-a936-173a0d033e1f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:11.065244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ec18e-0503-4fd3-a936-173a0d033e1f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:11.075005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:11.079365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.079671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.083472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.101540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:11.104090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.123273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:11.128420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:11.161354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 831/1661] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:11.162262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:11.172035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.207557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da986b7a-93b1-4138-a744-71edeade335c service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:11.226150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:11.227124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.227398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.227758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] PATH_INFO: `/v3/projects/6b920505d820478983cef9ecfae1df55` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.230192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b920505d820478983cef9ecfae1df55)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:11.231617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: WARNING py.warnings [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:11.231617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: warnings.warn(msg) Feb 10 03:37:11.231617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: Feb 10 03:37:11.236596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:11.284696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ed65-ca3c-4c08-a066-ca17e632ed6a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:11.297512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:11.298195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.299019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.299452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.304607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.342394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:11.344222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c6b3b-9033-4805-9f1d-4e245dbb3ce7 service placement] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:11.353566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b920505d820478983cef9ecfae1df55', 'request_id': 'req-8a071831-d8bf-4b1a-a10b-d818451c87fc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:11.368464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b920505d820478983cef9ecfae1df55', 'request_id': 'req-8a071831-d8bf-4b1a-a10b-d818451c87fc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:11.383872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 831/1662] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:37:11.387914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b920505d820478983cef9ecfae1df55', 'request_id': 'req-8a071831-d8bf-4b1a-a10b-d818451c87fc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:11.457824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] The token cache is being invalidate because project 6b920505d820478983cef9ecfae1df55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:11.460212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:11.461308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8a071831-d8bf-4b1a-a10b-d818451c87fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:11.464724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 832/1663] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:11 2022] DELETE /identity/v3/projects/6b920505d820478983cef9ecfae1df55 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:11.470018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.470471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.470885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.509358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:11.510298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.723622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 832/1664] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:11.731946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.732565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.733027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.767128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:11.768452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:11.798279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 833/1665] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:11.800661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:11.821115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc35b6-0ae1-4984-be14-426e7c414b79 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:11.831748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:11.832581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.832975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.833351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.834312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:11.834729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:11.836546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:11.865629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 833/1666] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:11.867551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:11.880128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fcbb-ad25-4edf-95aa-4c39e3a886ff None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:11.903224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:11.905655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:11.906057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:11.906452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:11.907331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:11.911254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:12.011918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 834/1667] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:12.012133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:12.038023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d62f1-e13c-4bc1-8618-69e68033168d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:12.269100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:12.272027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:12.272347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:12.272648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:12.275292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:12.282230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:12.335859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 834/1668] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:12 2022] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:12.338480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:12.367800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9af3ed-a5cd-4b92-86c1-4bdfb85aa9d4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:12.384984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:12.385850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:12.386973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:12.387374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:12.388949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:12.395305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:12.434732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 835/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:12.443462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:12.462049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5601a-abff-4f49-88a0-c0cb2ed1f742 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:12.489904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:12.490816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:12.491214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:12.491596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:12.492505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:12.494350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591909f-a2c4-4f04-9f09-231cf82eeb84 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:12.522093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:12.528480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 835/1670] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:12.534917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc2a45-0f53-4047-b2f2-9a6002910199 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:12.548211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:12.549568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:12.550120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:12.550634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] PATH_INFO: `/v3/projects/d9b162de8c624f2c91a4e0fbc3b00e60/users/9d46761f5d5b41259bc16d2aa4d48770/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:12.590043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b162de8c624f2c91a4e0fbc3b00e60, user_id=9d46761f5d5b41259bc16d2aa4d48770, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:12.593722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:12.626906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 836/1671] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:12 2022] PUT /identity/v3/projects/d9b162de8c624f2c91a4e0fbc3b00e60/users/9d46761f5d5b41259bc16d2aa4d48770/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:12.635050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:12.635398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:12.635750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:12.723615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] MFA Rules not processed for user `9d46761f5d5b41259bc16d2aa4d48770`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:12.725555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:13.059941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 836/1672] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:13.062205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:13.330736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c046c1-edb9-4b4b-9770-eaadde96010f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:13.348884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:13.351218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:13.352967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:13.354748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:13.355793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:13.362329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:13.493668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 837/1673] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:13 2022] POST /identity/v3/projects => generated 373 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:13.500959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:13.526309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e604a27-015c-4b7e-8395-03ef696262f8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:13.611540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:13.612714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:13.613163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:13.613588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:13.614814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:13.617304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:13.665540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 837/1674] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:13 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:13.673117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:13.692348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346aa44-078f-45a7-a686-5eec03c69f55 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:13.718816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:13.719811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:13.720281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:13.720745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:13.722130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:13.730405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:13.785581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 838/1675] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:13.789908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:13.817898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20b430-f5ab-40e3-b91c-0434da6c2007 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:13.861282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:13.862464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:13.862960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:13.863385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] PATH_INFO: `/v3/projects/83d1fb80bff84af297f5e2b274715690/users/b5cb1df470444f02b07c237474de93e2/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:13.939815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d1fb80bff84af297f5e2b274715690, user_id=b5cb1df470444f02b07c237474de93e2, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:13.949244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:13.993540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 838/1676] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:13 2022] PUT /identity/v3/projects/83d1fb80bff84af297f5e2b274715690/users/b5cb1df470444f02b07c237474de93e2/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:13.998091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:14.028229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a02a23-dc2a-4109-847b-345b8ab52da9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:14.210102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:14.211416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:14.211720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:14.212514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:14.214040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:14.218004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf7ef-efbb-4d55-8f0e-66af57cab8c2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:14.251562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:14.253711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 839/1677] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:14.271335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678fea-b2b3-4fd4-8dfb-674d22223906 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:14.295596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:14.296526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:14.296818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:14.297092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] PATH_INFO: `/v3/projects/83d1fb80bff84af297f5e2b274715690/users/b5cb1df470444f02b07c237474de93e2/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:14.306805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d1fb80bff84af297f5e2b274715690, user_id=b5cb1df470444f02b07c237474de93e2, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:14.309523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:14.334915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 839/1678] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:14 2022] PUT /identity/v3/projects/83d1fb80bff84af297f5e2b274715690/users/b5cb1df470444f02b07c237474de93e2/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:14.345151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a153-e4d4-48f5-8689-5f23d094521d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:14.345564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a153-e4d4-48f5-8689-5f23d094521d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:14.346360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a153-e4d4-48f5-8689-5f23d094521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:14.416846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2aa6a153-e4d4-48f5-8689-5f23d094521d None None] MFA Rules not processed for user `b5cb1df470444f02b07c237474de93e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:14.418921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2aa6a153-e4d4-48f5-8689-5f23d094521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:14.603810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 840/1679] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:14.613975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:14.616807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:14.785896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176aa97-a5e6-43cf-b58b-c2db32a38f04 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:14.811011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:14.812099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:14.812594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:14.813151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:14.835862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:14.837937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:14.920890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 840/1680] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:15.676858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:15.677352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:15.679421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:15.756158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] MFA Rules not processed for user `d637094d14264332b6a947fe1e5c0ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:15.758725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:15.847408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:15.972824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 841/1681] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:15.983457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:15.987051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:16.027697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16be1-f3ab-4829-aeb5-e8c129007c82 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:16.035794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:16.037045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:16.037647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:16.038055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] PATH_INFO: `/v3/users/9d46761f5d5b41259bc16d2aa4d48770` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:16.039688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d46761f5d5b41259bc16d2aa4d48770)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:16.042451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:16.145017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d46761f5d5b41259bc16d2aa4d48770'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:16.163403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d46761f5d5b41259bc16d2aa4d48770'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:16.164671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d46761f5d5b41259bc16d2aa4d48770'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:16.177311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6e6b-a950-4021-8f89-8d6fa04a63aa None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:16.177642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d46761f5d5b41259bc16d2aa4d48770'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:16.186234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:16.187369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:16.187647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:16.187918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:16.195913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6dba0d07-3599-4e18-9206-1a11e8e2ed13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d46761f5d5b41259bc16d2aa4d48770'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:16.205732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 841/1682] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:15 2022] DELETE /identity/v3/users/9d46761f5d5b41259bc16d2aa4d48770 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:16.210782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:16.211075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:16.211323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:16.223003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:16.227720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:16.256842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:16.259136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:16.267775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 842/1683] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:16.423474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 842/1684] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:16.435707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:16.437932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:16.622331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165e0b-cbf6-4fe5-be15-d10a14d917a4 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:16.765244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:16.765910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:16.766218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:16.766480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:16.793124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:16.794603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16077c-26a0-47cd-bfd4-3dd539b2c689 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:16.812473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 843/1685] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:16.850823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:16.855378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:16.895907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596f4f-3459-469b-9c2c-a1409e1ee1a4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:16.925143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:16.926288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:16.926754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:16.927180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] PATH_INFO: `/v3/users/523f67bc2d8f4f7298dc6b7d1fd09515` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:16.930284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523f67bc2d8f4f7298dc6b7d1fd09515)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:16.937212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:17.093468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523f67bc2d8f4f7298dc6b7d1fd09515'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:17.113153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523f67bc2d8f4f7298dc6b7d1fd09515'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:17.114098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523f67bc2d8f4f7298dc6b7d1fd09515'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:17.144085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523f67bc2d8f4f7298dc6b7d1fd09515'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:17.192734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523f67bc2d8f4f7298dc6b7d1fd09515'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:17.220942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 843/1686] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:16 2022] DELETE /identity/v3/users/523f67bc2d8f4f7298dc6b7d1fd09515 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:17.225696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b585-1095-4ead-a55d-72025ee0e5e8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:17.226145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b585-1095-4ead-a55d-72025ee0e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:17.226530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b585-1095-4ead-a55d-72025ee0e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:17.271429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-32c8b585-1095-4ead-a55d-72025ee0e5e8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:17.273128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-32c8b585-1095-4ead-a55d-72025ee0e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:17.409802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 844/1687] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:17.430612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:17.432680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:17.528427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f886d2-8ba0-4c48-9399-8845fadce393 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:17.548374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:17.549137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:17.549908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:17.550248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:17.582681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:17.586671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:17.609656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 844/1688] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:17.846339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:17.846880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:17.846972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:17.927211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:17.933009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:18.139974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 845/1689] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:18.416082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:18.418407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:18.442974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d88e-7252-4f35-8fd8-8fc0810180ee service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:18.453883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:18.455096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:18.455586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:18.455863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] PATH_INFO: `/v3/projects/d9b162de8c624f2c91a4e0fbc3b00e60` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:18.462158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b162de8c624f2c91a4e0fbc3b00e60)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:18.462567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:18.529470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:18.531311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:18.596144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b162de8c624f2c91a4e0fbc3b00e60', 'request_id': 'req-7ebda40c-560b-4f7c-8fd9-1807963747b8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:18.608531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b162de8c624f2c91a4e0fbc3b00e60', 'request_id': 'req-7ebda40c-560b-4f7c-8fd9-1807963747b8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:18.626349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b162de8c624f2c91a4e0fbc3b00e60', 'request_id': 'req-7ebda40c-560b-4f7c-8fd9-1807963747b8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:18.693781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c469ca-717d-4a69-b1d9-aeeeb4b3a9d5 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:18.704164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] The token cache is being invalidate because project d9b162de8c624f2c91a4e0fbc3b00e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:18.704666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:18.706407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:18.713717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 845/1690] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:18 2022] DELETE /identity/v3/projects/d9b162de8c624f2c91a4e0fbc3b00e60 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:18.722610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:18.726089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:18.836079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:18.836944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:18.837383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:18.837800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:18.846835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:18.971446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:18.973110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:18.978792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda40c-560b-4f7c-8fd9-1807963747b8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:18.990685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:18.993201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:18.993505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:18.994964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] PATH_INFO: `/v3/users/b5cb1df470444f02b07c237474de93e2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:18.996551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cb1df470444f02b07c237474de93e2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:18.997612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 846/1691] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:37:19.001336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:19.120417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cb1df470444f02b07c237474de93e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.146763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cb1df470444f02b07c237474de93e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.148579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cb1df470444f02b07c237474de93e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.177856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cb1df470444f02b07c237474de93e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.220472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c1a8a401-e6a2-4f8d-ad17-abe7f102688c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cb1df470444f02b07c237474de93e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.251356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 846/1692] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:18 2022] DELETE /identity/v3/users/b5cb1df470444f02b07c237474de93e2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:19.518785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:19.521347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:19.565106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a016-795d-4156-9f69-0c4e05c231e0 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:19.731831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:19.733236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:19.735919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:19.736385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] PATH_INFO: `/v3/users/ec1e8228ef0a4c448fd66689918e941f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:19.742154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1e8228ef0a4c448fd66689918e941f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:19.748514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:19.972810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1e8228ef0a4c448fd66689918e941f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:19.995390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1e8228ef0a4c448fd66689918e941f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.042509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1e8228ef0a4c448fd66689918e941f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.044878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1e8228ef0a4c448fd66689918e941f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.071966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1e8228ef0a4c448fd66689918e941f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.090828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 847/1693] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:19 2022] DELETE /identity/v3/users/ec1e8228ef0a4c448fd66689918e941f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:20.092682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:20.093197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:20.093293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:20.159693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:20.164284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:20.215451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:20.217018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:20.462577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 847/1694] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:20.485921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b622-0b18-41e0-9414-dce9b8f0c34c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:20.507820 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:20.512805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:20.514688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:20.523069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] PATH_INFO: `/v3/projects/defc94e1dbd94cbc896a8c42ba6ddda3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:20.536852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=defc94e1dbd94cbc896a8c42ba6ddda3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:20.536852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:20.551633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:20.553289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:20.731051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'defc94e1dbd94cbc896a8c42ba6ddda3', 'request_id': 'req-ffb433f3-74ad-4265-b182-0322083bb454'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.760912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'defc94e1dbd94cbc896a8c42ba6ddda3', 'request_id': 'req-ffb433f3-74ad-4265-b182-0322083bb454'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.786385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'defc94e1dbd94cbc896a8c42ba6ddda3', 'request_id': 'req-ffb433f3-74ad-4265-b182-0322083bb454'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.811682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb613ba-5e26-4c87-ae44-321dea5ca71d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:20.827147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] The token cache is being invalidate because project defc94e1dbd94cbc896a8c42ba6ddda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:20.827756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.830187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:20.843576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 848/1695] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:20 2022] DELETE /identity/v3/projects/defc94e1dbd94cbc896a8c42ba6ddda3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:20.844741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:20.853557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:21.057919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:21.061272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:21.063914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:21.065944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:21.079313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:21.164074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb433f3-74ad-4265-b182-0322083bb454 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:21.185280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:21.189705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:21.193665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:21.195860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] PATH_INFO: `/v3/users/3171fe4414f9449f9d783a6da0aebca1` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:21.198975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3171fe4414f9449f9d783a6da0aebca1)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:21.212996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:21.367177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:21.372427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207dee-54f0-4aab-96f6-6dccf13ed0c3 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:21.399217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3171fe4414f9449f9d783a6da0aebca1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.427732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3171fe4414f9449f9d783a6da0aebca1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.430177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 848/1696] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:37:21.434306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:21.437032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:21.437414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:21.458200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3171fe4414f9449f9d783a6da0aebca1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.460583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3171fe4414f9449f9d783a6da0aebca1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.479838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3171fe4414f9449f9d783a6da0aebca1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.496198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 849/1697] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:20 2022] DELETE /identity/v3/users/3171fe4414f9449f9d783a6da0aebca1 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:21.497875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:21.501469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:21.505496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:21.508696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:21.656941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 849/1698] 10.222.0.21 () {58 vars in 1015 bytes} [Thu Feb 10 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:21.700973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413da5-65a2-4e74-9347-e4121992ca88 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:21.727638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:21.729578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:21.730224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:21.730756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] PATH_INFO: `/v3/projects/83d1fb80bff84af297f5e2b274715690` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:21.733173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d1fb80bff84af297f5e2b274715690)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:21.736060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:21.860628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d1fb80bff84af297f5e2b274715690', 'request_id': 'req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.875798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d1fb80bff84af297f5e2b274715690', 'request_id': 'req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.877404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:21.879034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:21.895648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d1fb80bff84af297f5e2b274715690', 'request_id': 'req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.915130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd06d-f156-41d9-8a62-98932e4dd2c0 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:21.929683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] The token cache is being invalidate because project 83d1fb80bff84af297f5e2b274715690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:21.930126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.932095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-42dfbc28-9ed9-4fbf-b213-837bcbd196d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:21.938426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 850/1699] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:21 2022] DELETE /identity/v3/projects/83d1fb80bff84af297f5e2b274715690 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:21.946309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:21.946710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:21.947142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.057313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:22.058555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:22.189980 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:22.196429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:22.210814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:22.210814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.210814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:22.247470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:22.253963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d64175-ca44-44a4-8d76-bc25ff8d9a2e service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:22.288509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 850/1700] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:22.304416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 851/1701] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:22.314289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:22.314719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:22.315095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.441751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:22.461301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:22.490446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 851/1702] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:22.494996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:22.511716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590231-228e-422d-9919-0cdb09c6a9e2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:22.534951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:22.535694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:22.539195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:22.539517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.544131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:22.546861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:22.555959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:22.629110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 852/1703] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:37:22.633373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:22.648989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09026b-de7b-46dc-9007-d792fb468c32 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:22.676597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:22.677427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:22.678031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:22.678413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.679412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:22.681543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:22.769614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 852/1704] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:22.773598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:22.786961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8518cbf-2007-439d-8b32-190cb5755886 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:22.931646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:22.932368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:22.932654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:22.932917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:22.938355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:22.944603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.021836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.036844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 853/1705] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:22 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:23.036977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075976f-621b-4d90-9b52-9fa71479b483 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:23.057766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:23.058488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.064037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.064409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.068189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:23.074342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.132431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.158974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 853/1706] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:23.160523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e19e-8dd4-4065-b450-7a43cc36a171 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:23.178175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:23.179313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.180919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.181362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.189014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:23.193476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.215146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.216921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 854/1707] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:23.217739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:23.221335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.240186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4a35-8a24-427f-b895-cd6c964407ae admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:23.251045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d53f-27e0-4569-adb8-240095f3b03f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:23.254105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:23.258509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.259394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.260272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] PATH_INFO: `/v3/projects/2c945afda23742628c0c1945d26a5be5` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.263721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c945afda23742628c0c1945d26a5be5)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:23.266632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:23.268644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.269293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.270152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.271992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] PATH_INFO: `/v3/projects/58ea505fee534e0d9880a660269051cf/users/ffaf2d4d23264c5392afc392966ce73e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.333696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ea505fee534e0d9880a660269051cf, user_id=ffaf2d4d23264c5392afc392966ce73e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:23.351383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb2c8b-0a61-4ac2-8964-71473fb9da10 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.388798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 855/1708] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:23 2022] PUT /identity/v3/projects/58ea505fee534e0d9880a660269051cf/users/ffaf2d4d23264c5392afc392966ce73e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:23.400558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.401263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.401540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.459345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] MFA Rules not processed for user `ffaf2d4d23264c5392afc392966ce73e`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:23.461397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:23.463212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c945afda23742628c0c1945d26a5be5', 'request_id': 'req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:23.491362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c945afda23742628c0c1945d26a5be5', 'request_id': 'req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:23.511130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c945afda23742628c0c1945d26a5be5', 'request_id': 'req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:23.539610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] The token cache is being invalidate because project 2c945afda23742628c0c1945d26a5be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:23.540886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:23.545215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-33b5f2b7-6a8e-41b8-bf9c-4c0fba89050e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:23.556034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 854/1709] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:23 2022] DELETE /identity/v3/projects/2c945afda23742628c0c1945d26a5be5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:23.562258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423963-4623-4554-8589-e13044714d61 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.564330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423963-4623-4554-8589-e13044714d61 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.565059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423963-4623-4554-8589-e13044714d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.620345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 856/1710] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:23.621466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.627454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:23.662411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b3423963-4623-4554-8589-e13044714d61 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:23.667196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b3423963-4623-4554-8589-e13044714d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:23.803561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0c8f-89a3-4a26-b4cc-eadf384f9510 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:23.812201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:23.813909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.814441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.814872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.816232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:23.820279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:23.844605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 855/1711] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:23.853031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:23.853124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:23.853586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:23.875077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 857/1712] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:23.879521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:23.899400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:23.902451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:24.054575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfac3d-d81b-43b0-b3d4-bdffe69b03d8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.068220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.068923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.069203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.069474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.073063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.077298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.124535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 858/1713] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:23 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:24.126145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 856/1714] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:24.129039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.129214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.140672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58757f6-035d-457e-a8dc-620854b96040 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.147149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.148178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.148541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.148864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.149723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:24.150090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.152853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.153801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2c5f4-d0a0-4784-8f52-99dd31395a43 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.168543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.169130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.169410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.172373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.173316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.176362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 857/1715] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:24.177437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.178349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.191181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb614af-7e1c-42da-b169-2ddb41d5f204 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.197731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.198574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.199103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.199636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.200443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.203135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.216824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 859/1716] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:24.218402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.244444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953efb93-319e-4f00-877b-3eee4ce7b6a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.256087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 858/1717] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:24 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:24.258612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.513096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.514482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.514778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.515086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] PATH_INFO: `/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87/users/51d0fc016a89483480af1e24e356bd63/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.519363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0572-8d7e-46a2-acbf-44b30ac4546e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.533228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.533931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.534215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.534490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.543195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.545750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816b74-f67b-402f-9615-9377f16e5863 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.568902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2781f7d6a24f5082f3b5a4eb658c87, user_id=51d0fc016a89483480af1e24e356bd63, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.571646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.600767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 859/1718] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:24 2022] POST /identity/v3/users => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:24.602273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.602562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.602858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.629940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 860/1719] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:24 2022] PUT /identity/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87/users/51d0fc016a89483480af1e24e356bd63/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:24.631472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.704132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] MFA Rules not processed for user `fc1ef6f6170f4ccb9e3b439ac3fd56e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:24.706326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:24.904222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d028f3-fea6-4fc7-80a8-0aa93429331e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.923894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:24.924748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:24.925164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:24.925522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:24.927016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:24.928774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:24.935996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 860/1720] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:24.938094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.958483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 861/1721] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:24.960993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:24.963667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:24.997939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613357-48cd-4f33-bcdc-bce51ceb5006 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:24.999555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2827-636f-44f9-bab9-d6906f91a6a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:25.009311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.013968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.014383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.014927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] PATH_INFO: `/v3/projects/38182e2a2d19434b817bbceee0eb3c3c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.015754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.016484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=38182e2a2d19434b817bbceee0eb3c3c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.018799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.019788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.021211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.022733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.024666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.030499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.059070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 861/1722] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:25.060117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.062163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.168743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38182e2a2d19434b817bbceee0eb3c3c', 'request_id': 'req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:25.175211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38182e2a2d19434b817bbceee0eb3c3c', 'request_id': 'req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:25.196714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38182e2a2d19434b817bbceee0eb3c3c', 'request_id': 'req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:25.216673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] The token cache is being invalidate because project 38182e2a2d19434b817bbceee0eb3c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:25.217960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:25.219919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:25.222902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 862/1723] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:24 2022] DELETE /identity/v3/projects/38182e2a2d19434b817bbceee0eb3c3c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:25.224026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.225530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.229321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3b8d7-31ce-4943-b54f-b52b006fadb9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:25.346423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.347439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.348053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.348397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.351383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.406565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310b5c4-2726-4f4d-8fec-0d8a677e82ab admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:25.429124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.432104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.432437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.432766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.433537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.439494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.467503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 863/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:25.468429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.472479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.474195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.477210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e5afe-7345-48f1-94aa-c5f7910d35a0 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.508757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 862/1725] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:25.511430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6e01-0e46-4595-b805-1de9a3bdb52e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:25.511587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcee3-6487-48bb-9795-53d57044b3e5 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.514226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcee3-6487-48bb-9795-53d57044b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.514631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcee3-6487-48bb-9795-53d57044b3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.544522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.546702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.548216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.549312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] PATH_INFO: `/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87/users/51d0fc016a89483480af1e24e356bd63/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.555007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2781f7d6a24f5082f3b5a4eb658c87, user_id=51d0fc016a89483480af1e24e356bd63, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.565125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.572908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-588bcee3-6487-48bb-9795-53d57044b3e5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:25.574325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-588bcee3-6487-48bb-9795-53d57044b3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.584678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 864/1726] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:25 2022] PUT /identity/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87/users/51d0fc016a89483480af1e24e356bd63/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:25.586201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.680023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 863/1727] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:25.681580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcaa3-640e-4a13-a997-9143bbcd292a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.686148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcaa3-640e-4a13-a997-9143bbcd292a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.686940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcaa3-640e-4a13-a997-9143bbcd292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.724983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-821dcaa3-640e-4a13-a997-9143bbcd292a None None] MFA Rules not processed for user `51d0fc016a89483480af1e24e356bd63`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:25.726577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-821dcaa3-640e-4a13-a997-9143bbcd292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.822481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 864/1728] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:25.824940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.825326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.825670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.833864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e32-49de-4d78-a454-14385f1c516c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:25.847275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:25.848565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:25.848770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.849785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:25.850079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:25.850520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] PATH_INFO: `/v3/projects/bafbe7581d1a4a5eba4a495797a7c13b/users/2e75ecf75806407fbbe020abe6d354c3/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:25.859943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 865/1729] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:25.862032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.864156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:25.885336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafbe7581d1a4a5eba4a495797a7c13b, user_id=2e75ecf75806407fbbe020abe6d354c3, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:25.888253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:25.917241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 865/1730] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:25 2022] PUT /identity/v3/projects/bafbe7581d1a4a5eba4a495797a7c13b/users/2e75ecf75806407fbbe020abe6d354c3/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:25.921148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:25.969124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531328c-c686-4b4e-94ba-48c5a5d128de None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.083784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d90f9-d60e-448d-9c69-05dd4cd53e95 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.097173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.098345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.098821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.099246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.101737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:26.102825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.109256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d88b64-9576-4825-9cd9-1393bc7fa007 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.109747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.110432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.110736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.111013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.141520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 866/1731] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:26.146377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258960ad-7090-4938-9fc3-0af07376859b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.147089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258960ad-7090-4938-9fc3-0af07376859b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.147381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258960ad-7090-4938-9fc3-0af07376859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.196655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-258960ad-7090-4938-9fc3-0af07376859b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:26.201439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-258960ad-7090-4938-9fc3-0af07376859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:26.222367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 867/1732] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:26.223593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258960ad-7090-4938-9fc3-0af07376859b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.235319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258960ad-7090-4938-9fc3-0af07376859b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.242612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.243375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.243657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.244113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.244841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.248396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.280063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.280372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.304231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 868/1733] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:26.305651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.312446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:26.317627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 866/1734] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:26.320417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.354918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844e09-71e5-4c8f-8fe4-04dcfdcf237a service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.465237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.465947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.466240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.466497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.469840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.473773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.486158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a629b-9c4f-4437-9924-e921cbabdb63 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.496717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.497621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.497905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.498323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.520175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 867/1735] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:26 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:26.523295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.526829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.534828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.566809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7929-0404-4bc8-86cc-28eec4c8a747 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.593229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 869/1736] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:26.597153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.597864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.598149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.598426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.605729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.607463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.648572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.655655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 868/1737] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:26.661117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649f54-02be-4b22-932b-3e387d76df52 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.689670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.693854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.698527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.698894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.705480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.711642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c50ab-7a49-437a-a602-f63b398f9575 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.747390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:26.754902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 870/1738] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:26.761718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1b83-d3c6-4e85-b61b-3deb4f113615 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:26.785781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:26.786756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.787045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.787321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] PATH_INFO: `/v3/projects/505e478a1e424b22b8ac0f30ef1545cd/users/f30a743e837842b5983ade5ab0b9f3ca/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.842289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=505e478a1e424b22b8ac0f30ef1545cd, user_id=f30a743e837842b5983ade5ab0b9f3ca, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:26.845039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca206a-1fa8-4923-aca1-dcabf8ff9b2f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:26.849693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cff9-1066-4d41-bb9a-6e33827ea4fe None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.850366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cff9-1066-4d41-bb9a-6e33827ea4fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.850835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cff9-1066-4d41-bb9a-6e33827ea4fe None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.853186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 871/1739] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 10 03:37:26.904764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 869/1740] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:26 2022] PUT /identity/v3/projects/505e478a1e424b22b8ac0f30ef1545cd/users/f30a743e837842b5983ade5ab0b9f3ca/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:26.915785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:26.916058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:26.916334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:26.988846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] MFA Rules not processed for user `f30a743e837842b5983ade5ab0b9f3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:26.990320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:27.052220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:27.052801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:27.053323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:27.122404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:27.123773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:27.174318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 872/1741] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:27.175497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:27.445269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 870/1742] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:37:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:27.454512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43199964-fc2d-4bc3-8d83-0fd941188fb9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:27.478872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:27.484872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:27.485828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:27.485828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:27.486383 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:27.496590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:27.610465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 873/1743] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:27 2022] POST /identity/v3/projects => generated 381 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:27.613907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:27.644168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ff003-7c8e-409d-8807-2d00c56529ea None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:27.662232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:27.781059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:27.781733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:27.782160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:27.782332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:27.783063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:27.787518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:27.834771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 871/1744] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:27 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:27.835897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:27.837643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:27.850400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8a89-52e2-4ea5-b43d-cceedc5a7710 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:27.876922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:27.878067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:27.879262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:27.879673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] PATH_INFO: `/v3/users/ffaf2d4d23264c5392afc392966ce73e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:27.881230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffaf2d4d23264c5392afc392966ce73e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:27.883833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:27.984830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffaf2d4d23264c5392afc392966ce73e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:28.004907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffaf2d4d23264c5392afc392966ce73e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:28.037402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffaf2d4d23264c5392afc392966ce73e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:28.040522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6d5a-3c30-4853-bab4-ec9bb9e2dfd4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.042168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffaf2d4d23264c5392afc392966ce73e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:28.046584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:28.047251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.047538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.047818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.058518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffaf2d4d23264c5392afc392966ce73e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:28.070260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:28.078226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 874/1745] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:27 2022] DELETE /identity/v3/users/ffaf2d4d23264c5392afc392966ce73e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:28.078460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4b192-ad78-4471-8d73-04e5f41731d9 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:28.078558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.081386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:28.104501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 872/1746] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:28.106987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c47e9-3dbe-483e-83fd-2ab697faa966 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.107277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c47e9-3dbe-483e-83fd-2ab697faa966 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.107554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c47e9-3dbe-483e-83fd-2ab697faa966 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.119805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 873/1747] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:37:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:28.121285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.121574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.122208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.165319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:28.166634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:28.288836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea05c9-782e-4aa0-9b02-5bb9befa99ce admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.297122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:28.297457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.297702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.298323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.299006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:28.303413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:28.333754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 874/1748] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:28.358736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 875/1749] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:28.359919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.361711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:28.362041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.391553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec35c93-a768-4ebd-b2c3-ce8cc4e16a95 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.443596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:28.444724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.445111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.445483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] PATH_INFO: `/v3/projects/1668ec254b1e438dbcaffdecb28cabaf/users/a2642640ea174cfc890b40da483a4e1f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.497919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3859b-7d32-4daa-b9b2-d409c568f093 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.501995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:28.502620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.503061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.503565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.516891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:28.518936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920b96-d4cf-4914-a5ec-220ff310eea5 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:28.532208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 875/1750] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:28.534228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.534860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.535306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.538424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1668ec254b1e438dbcaffdecb28cabaf, user_id=a2642640ea174cfc890b40da483a4e1f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:28.549181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:28.555260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:28.556754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:28.592199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 876/1751] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:28 2022] PUT /identity/v3/projects/1668ec254b1e438dbcaffdecb28cabaf/users/a2642640ea174cfc890b40da483a4e1f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:28.593768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.774453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 876/1752] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:28.807974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.809948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:28.859223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48f9b-512c-42ef-9ef3-f0b0307c2397 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.912936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce939d-02d9-4519-b682-79d193732952 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:28.931478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:28.932227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:28.932640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:28.932763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:28.933682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:28.935503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:28.954719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 877/1753] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:28.968587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:28.995663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa6907-9b87-4ef3-92d7-2f17f5f2f23e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:29.010304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:29.012472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:29.014735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:29.015511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] PATH_INFO: `/v3/projects/1668ec254b1e438dbcaffdecb28cabaf/users/a2642640ea174cfc890b40da483a4e1f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:29.028301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1668ec254b1e438dbcaffdecb28cabaf, user_id=a2642640ea174cfc890b40da483a4e1f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:29.038107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a540d7-5039-4140-91d3-cd4d451d5bd6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:29.050974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:29.054433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:29.055138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:29.055643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:29.073845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 878/1754] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:28 2022] PUT /identity/v3/projects/1668ec254b1e438dbcaffdecb28cabaf/users/a2642640ea174cfc890b40da483a4e1f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:29.088622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87fc6-382f-49fc-b60e-fcbe0e2728fe None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:29.088977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:29.089465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87fc6-382f-49fc-b60e-fcbe0e2728fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:29.089939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87fc6-382f-49fc-b60e-fcbe0e2728fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:29.090763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:29.107756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 877/1755] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:29.165598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-72d87fc6-382f-49fc-b60e-fcbe0e2728fe None None] MFA Rules not processed for user `a2642640ea174cfc890b40da483a4e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:29.169388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-72d87fc6-382f-49fc-b60e-fcbe0e2728fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:29.387617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 879/1756] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:29.395391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:29.398966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:29.584588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3d41-838d-4864-80da-56e2ff2cb55a service nova] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:29.704528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:29.705456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:29.708523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:29.711630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:29.732764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:29.736814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:29.767487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:29.767841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:29.768122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:29.776511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 878/1757] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:29.823488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] MFA Rules not processed for user `d637094d14264332b6a947fe1e5c0ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:29.824905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:29.977198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:30.006452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735d73-ec36-4d70-9909-5fefa4c422ff service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:30.017730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:30.020135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:30.020418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:30.020696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:30.031361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:30.044837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 880/1758] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:30.232672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:30.236917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff1817-1c11-46ec-a0d9-0f3494b878b2 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:30.301252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 879/1759] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:30.970769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:31.150090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe21b7-a028-4ff2-8436-6a87cf4c5e25 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:31.156010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:31.157078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:31.157434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:31.157764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] PATH_INFO: `/v3/users/f30a743e837842b5983ade5ab0b9f3ca` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:31.159173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30a743e837842b5983ade5ab0b9f3ca)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:31.162251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:31.255281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30a743e837842b5983ade5ab0b9f3ca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:31.272680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30a743e837842b5983ade5ab0b9f3ca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:31.298513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30a743e837842b5983ade5ab0b9f3ca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:31.299511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30a743e837842b5983ade5ab0b9f3ca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:31.316238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30a743e837842b5983ade5ab0b9f3ca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:31.345874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 881/1760] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:30 2022] DELETE /identity/v3/users/f30a743e837842b5983ade5ab0b9f3ca => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:31.350839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434499-e6e2-4f72-b58a-f5e7e814145c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:31.351440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434499-e6e2-4f72-b58a-f5e7e814145c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:31.351440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434499-e6e2-4f72-b58a-f5e7e814145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:31.389424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d1434499-e6e2-4f72-b58a-f5e7e814145c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:31.390684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d1434499-e6e2-4f72-b58a-f5e7e814145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:31.532860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 880/1761] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:31.591537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:31.593125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:31.717333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72594c-21c4-4566-ba19-a4f9cfb1e5ad admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:31.729985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:31.731039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:31.731483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:31.732055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:31.784167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:31.791478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:31.832833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 882/1762] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:31.883253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:31.883595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:31.883933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:31.950447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] MFA Rules not processed for user `2e75ecf75806407fbbe020abe6d354c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:31.952454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.097436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.099255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.124180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a84dd6-88e1-4d0c-a5d7-9add1ee2a963 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.148785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.149894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.150097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.150336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] PATH_INFO: `/v3/projects/58ea505fee534e0d9880a660269051cf` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.160455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ea505fee534e0d9880a660269051cf)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.162413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.193655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 881/1763] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:32.197032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.199814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.242229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8ae1-4b70-4fed-8a53-f87c6665eb7d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.262045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.263381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.263804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.265104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.266554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.276315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.318822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ea505fee534e0d9880a660269051cf', 'request_id': 'req-b87f6dd4-79f0-445c-810a-170935c85621'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.335244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ea505fee534e0d9880a660269051cf', 'request_id': 'req-b87f6dd4-79f0-445c-810a-170935c85621'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.352962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ea505fee534e0d9880a660269051cf', 'request_id': 'req-b87f6dd4-79f0-445c-810a-170935c85621'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.358094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 882/1764] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:32 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:32.360550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.403609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] The token cache is being invalidate because project 58ea505fee534e0d9880a660269051cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:32.409213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.411270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.415732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 883/1765] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:32 2022] DELETE /identity/v3/projects/58ea505fee534e0d9880a660269051cf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:32.420729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.428293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.522579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801dc23-b69b-4d99-82df-5968427bfbc4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.535655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.537908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.538321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.538601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.539517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.542630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.555988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6dd4-79f0-445c-810a-170935c85621 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.576310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.577226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.577505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.577780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] PATH_INFO: `/v3/users/51d0fc016a89483480af1e24e356bd63` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.589881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d0fc016a89483480af1e24e356bd63)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.593263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.597528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 883/1766] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:32 2022] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:32.604383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.611893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.634893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ae96-e1f3-4d11-a7d5-6cfc6babe10a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.645228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.645993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.646405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.647377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.648721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.651064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.667482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d0fc016a89483480af1e24e356bd63'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.668125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 884/1767] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:32.675861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.677796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d0fc016a89483480af1e24e356bd63'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.692960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d0fc016a89483480af1e24e356bd63'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.693799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d0fc016a89483480af1e24e356bd63'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.701484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9a8a7-5ec8-4114-8ff8-db02bb5bcb3d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.706534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d0fc016a89483480af1e24e356bd63'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.713837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.715237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.715636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.715960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] PATH_INFO: `/v3/projects/5b89656f99db489590be8bfe1020f3b0/users/c12457a1e8cb40648fdb5999eb4c276c/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.722875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 884/1768] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:32 2022] DELETE /identity/v3/users/51d0fc016a89483480af1e24e356bd63 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:32.737388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b89656f99db489590be8bfe1020f3b0, user_id=c12457a1e8cb40648fdb5999eb4c276c, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.740971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.762288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 885/1769] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:32 2022] PUT /identity/v3/projects/5b89656f99db489590be8bfe1020f3b0/users/c12457a1e8cb40648fdb5999eb4c276c/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:32.766017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.767755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.779301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.781172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:32.854610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb3a3-8d87-4913-8bf8-1f8b70ba8897 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.868321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47c4b-b90e-41ee-9efa-e6b396749bec admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.873680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.874563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.874950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.875226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] PATH_INFO: `/v3/projects/505e478a1e424b22b8ac0f30ef1545cd` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.876458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=505e478a1e424b22b8ac0f30ef1545cd)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.878631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.921552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:32.922234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:32.922516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:32.922818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:32.923567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:32.925201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:32.930162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505e478a1e424b22b8ac0f30ef1545cd', 'request_id': 'req-2f3c0a63-8895-4985-b059-c7280aa6b61a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.935821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 885/1770] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:32.936596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505e478a1e424b22b8ac0f30ef1545cd', 'request_id': 'req-2f3c0a63-8895-4985-b059-c7280aa6b61a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.939465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.945674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505e478a1e424b22b8ac0f30ef1545cd', 'request_id': 'req-2f3c0a63-8895-4985-b059-c7280aa6b61a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.949780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610658c7-9f8d-445b-9ff5-e53fb0ce8c91 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:32.960515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] The token cache is being invalidate because project 505e478a1e424b22b8ac0f30ef1545cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:32.960515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.961429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:32.963092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 886/1771] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:32 2022] DELETE /identity/v3/projects/505e478a1e424b22b8ac0f30ef1545cd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:32.967016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:32.968403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:33.014897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:33.015954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:33.016306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:33.016636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] PATH_INFO: `/v3/projects/5b89656f99db489590be8bfe1020f3b0/users/c12457a1e8cb40648fdb5999eb4c276c/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:33.018817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b89656f99db489590be8bfe1020f3b0, user_id=c12457a1e8cb40648fdb5999eb4c276c, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:33.021669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:33.033749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 886/1772] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:32 2022] PUT /identity/v3/projects/5b89656f99db489590be8bfe1020f3b0/users/c12457a1e8cb40648fdb5999eb4c276c/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:33.040740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0a63-8895-4985-b059-c7280aa6b61a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:33.104793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:33.105649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:33.106032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:33.107031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] PATH_INFO: `/v3/users/a2642640ea174cfc890b40da483a4e1f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:33.109116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2642640ea174cfc890b40da483a4e1f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:33.111225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:33.191974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2642640ea174cfc890b40da483a4e1f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.221056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2642640ea174cfc890b40da483a4e1f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.223677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2642640ea174cfc890b40da483a4e1f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.246165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2642640ea174cfc890b40da483a4e1f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.283701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3bcc9cec-af33-4b1b-9111-e082ccac5fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2642640ea174cfc890b40da483a4e1f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.294243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 887/1773] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:32 2022] DELETE /identity/v3/users/a2642640ea174cfc890b40da483a4e1f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:33.784884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:33.787164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:33.805236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1338-a425-4fee-982c-3a6201a2fe6b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:33.901005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:33.902123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:33.902527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:33.903136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] PATH_INFO: `/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:33.904762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2781f7d6a24f5082f3b5a4eb658c87)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:33.906885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:33.982088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2781f7d6a24f5082f3b5a4eb658c87', 'request_id': 'req-5834aee6-9c5b-43d1-af49-697360b734c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.988867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2781f7d6a24f5082f3b5a4eb658c87', 'request_id': 'req-5834aee6-9c5b-43d1-af49-697360b734c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:33.998915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2781f7d6a24f5082f3b5a4eb658c87', 'request_id': 'req-5834aee6-9c5b-43d1-af49-697360b734c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.020857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] The token cache is being invalidate because project 1b2781f7d6a24f5082f3b5a4eb658c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:34.021292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.022302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.024315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 887/1774] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:33 2022] DELETE /identity/v3/projects/1b2781f7d6a24f5082f3b5a4eb658c87 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:34.029307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206412f8-553b-423a-b547-384a148ca3dc None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.029784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206412f8-553b-423a-b547-384a148ca3dc None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.030116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206412f8-553b-423a-b547-384a148ca3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.051740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-206412f8-553b-423a-b547-384a148ca3dc None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:34.053533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-206412f8-553b-423a-b547-384a148ca3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.079961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.082297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.150696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 888/1775] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:34.158004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.159450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.159872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.170344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834aee6-9c5b-43d1-af49-697360b734c5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.175658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.176639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.176921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.177237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] PATH_INFO: `/v3/projects/1668ec254b1e438dbcaffdecb28cabaf` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.178492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1668ec254b1e438dbcaffdecb28cabaf)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.182299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.210876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:34.217111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.237136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 889/1776] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:34.238505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.247184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1668ec254b1e438dbcaffdecb28cabaf', 'request_id': 'req-e1ff2114-9163-4955-8bb1-2546bc833f32'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.251335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4e56-497a-430f-8d70-ebeb6b4968bf None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.261029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1668ec254b1e438dbcaffdecb28cabaf', 'request_id': 'req-e1ff2114-9163-4955-8bb1-2546bc833f32'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.272867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1668ec254b1e438dbcaffdecb28cabaf', 'request_id': 'req-e1ff2114-9163-4955-8bb1-2546bc833f32'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.286185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] The token cache is being invalidate because project 1668ec254b1e438dbcaffdecb28cabaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:34.286510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.287531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e1ff2114-9163-4955-8bb1-2546bc833f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:34.289370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 888/1777] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:34 2022] DELETE /identity/v3/projects/1668ec254b1e438dbcaffdecb28cabaf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:34.294246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9087-c905-4b0c-8b49-52d5fcf61d48 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.294534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9087-c905-4b0c-8b49-52d5fcf61d48 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.294838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9087-c905-4b0c-8b49-52d5fcf61d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.313412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-96ff9087-c905-4b0c-8b49-52d5fcf61d48 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:34.314624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-96ff9087-c905-4b0c-8b49-52d5fcf61d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.322147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.322866 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.323145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.323622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.324157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:34.324798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.326066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.346915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 890/1778] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:34.348184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.350063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.362586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24365-5843-4a32-b1d8-a9a6e5120f88 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.369216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.370077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.370364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.370638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.371698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.373771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.387160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 889/1779] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:34.396779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.397069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.397347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.406825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 891/1780] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:34.410434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.424875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:34.427099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.505689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330093f1-aaef-4e61-9001-67e6a8000c59 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.518473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.519211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.520186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.520299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.521812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.524278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 890/1781] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:34.526471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.529701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.555638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5d410-5c33-4772-9ef3-f299f3a8a6cb None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.570975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.571770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.571928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.572200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.572958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:34.573263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.574945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.608375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 892/1782] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:34.610574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.634298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0473c-d74b-4e09-a5b1-426236dc64d7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.641420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 891/1783] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:34.646905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.657649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.658392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.658747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.659029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.660045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.661966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bde0c6-6b03-4b2b-92c8-63c388e9760f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.675670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 893/1784] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:34.677052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.677529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.677823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.701174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce78c-9a32-415a-8094-3a46f2f6d43c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.708914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.710913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.711474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.712756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.714297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.719840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.723266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] MFA Rules not processed for user `c12457a1e8cb40648fdb5999eb4c276c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:34.724592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:34.763561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 892/1785] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:34.768593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.861892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 894/1786] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:34.863375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.878489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f702a-dd7b-422a-82c1-0cd379391bbe None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.908837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f3ee4-d492-4888-ba52-e0a089a207c5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.925492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.926222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.926508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.926812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.927575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.933061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:34.953342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 893/1787] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:34.955406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:34.975827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f0db4-d4d1-4751-81b2-2e90ca00e403 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:34.981346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.982806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.983705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:34.983844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.984010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] PATH_INFO: `/v3/projects/4673a544aee04895bae7ea3f9d9ef647/users/d3b41c2c0e434ee7a17d847fac3b197d/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.984400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:34.984829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:34.985302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:34.986047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:34.990184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5ae41-ea05-4b99-8d64-167ea5f010d8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.010501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4673a544aee04895bae7ea3f9d9ef647, user_id=d3b41c2c0e434ee7a17d847fac3b197d, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.013709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.030069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 895/1788] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:34 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:35.031303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 894/1789] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:34 2022] PUT /identity/v3/projects/4673a544aee04895bae7ea3f9d9ef647/users/d3b41c2c0e434ee7a17d847fac3b197d/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:35.032418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.042558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f48-3bf7-4438-83f9-0865f6452146 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.042872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f48-3bf7-4438-83f9-0865f6452146 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.043150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad92f48-3bf7-4438-83f9-0865f6452146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.067901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8ad92f48-3bf7-4438-83f9-0865f6452146 None None] MFA Rules not processed for user `fc1ef6f6170f4ccb9e3b439ac3fd56e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:35.069725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8ad92f48-3bf7-4438-83f9-0865f6452146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:35.136215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 896/1790] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:35.138125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.138592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.139077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.140333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127345-e07d-4210-9a70-75500436c02e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.147933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.148764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.149280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.149558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.150314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.152892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.167899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 895/1791] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:35.170797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] MFA Rules not processed for user `d3b41c2c0e434ee7a17d847fac3b197d`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:35.172029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:35.172175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.186968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21c37-004a-459c-8460-dc168d766843 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.207541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.208306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.208751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.209088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.211606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.213377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.237191 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 896/1792] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:35.238633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.255107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4e7-4e8f-4e91-911d-58efaca21d04 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.261003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.261985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.262334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.262691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] PATH_INFO: `/v3/projects/a4d12e929497402db0f630a96efefc78/users/f5378728b4964a35ad5ba8220d9222ef/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.291339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 897/1793] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:35.295960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.306111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d12e929497402db0f630a96efefc78, user_id=f5378728b4964a35ad5ba8220d9222ef, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.310061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754552a8-dc8f-4320-bc7e-a48502bc5889 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.310736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557f39-037d-4a8b-97d0-5dadff21291f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.317754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.318611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.319010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.319606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.320460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.322836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.330890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 897/1794] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:35 2022] PUT /identity/v3/projects/a4d12e929497402db0f630a96efefc78/users/f5378728b4964a35ad5ba8220d9222ef/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:35.342067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.342571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.343841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.357721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 898/1795] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:35.359032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.390419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] MFA Rules not processed for user `f5378728b4964a35ad5ba8220d9222ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:35.391746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:35.449403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986e14f-73e1-4761-8b08-169afbbde30f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.456233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.457390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.457890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.458368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.459300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.461622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.486329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 898/1796] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:35.490547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 899/1797] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:35.491618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.498450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.500819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:35.505696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f1f53-dc41-4198-9017-79a306cbd021 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.516482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.517426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.518289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.518758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.519901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.522960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.537035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 899/1798] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:37:35.541017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.556620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575e1ba-9ee7-4e00-90b5-be8290ee7621 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.564782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.566090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.566510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.566941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] PATH_INFO: `/v3/projects/37024c987fe24f79af26e25741b13270/users/f4070a106bde4f62a8f5c71bd5d4db85/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.577586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39416-8142-4d21-9d96-859c59b96d45 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.581904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.582679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.582984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.583263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.586853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=37024c987fe24f79af26e25741b13270, user_id=f4070a106bde4f62a8f5c71bd5d4db85, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.592218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.595236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.596935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.611015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 900/1800] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:35.611378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 900/1800] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:35 2022] PUT /identity/v3/projects/37024c987fe24f79af26e25741b13270/users/f4070a106bde4f62a8f5c71bd5d4db85/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:35.612409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.634364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.634621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67284b6-771e-4e98-b812-f6e9cf63c562 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.765999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.768600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.768943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.769226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.769983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.772301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.797165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b917c-2db9-40e6-9e6c-7fbea5e096ec admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.800437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 901/1801] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:35.805940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:35.816877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c360-8122-48db-bcb2-95ba61fda1fd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:35.819900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.820286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.821754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.821877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] PATH_INFO: `/v3/users/f5378728b4964a35ad5ba8220d9222ef` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.823747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5378728b4964a35ad5ba8220d9222ef)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.826102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.836065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:35.837064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.837249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.837619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] PATH_INFO: `/v3/projects/37024c987fe24f79af26e25741b13270/users/f4070a106bde4f62a8f5c71bd5d4db85/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.842507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37024c987fe24f79af26e25741b13270, user_id=f4070a106bde4f62a8f5c71bd5d4db85, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:35.845360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3fc63-fb4e-41d2-b8e2-0ab19b0ef5a0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:35.867678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 902/1802] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:35 2022] PUT /identity/v3/projects/37024c987fe24f79af26e25741b13270/users/f4070a106bde4f62a8f5c71bd5d4db85/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:35.879423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.880160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.880443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.896589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5378728b4964a35ad5ba8220d9222ef'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:35.925624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5378728b4964a35ad5ba8220d9222ef'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:35.942544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5378728b4964a35ad5ba8220d9222ef'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:35.943630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5378728b4964a35ad5ba8220d9222ef'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:35.959170 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6d769023-69e1-440c-9cef-b3429897fc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5378728b4964a35ad5ba8220d9222ef'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:35.970271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 901/1803] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:35 2022] DELETE /identity/v3/users/f5378728b4964a35ad5ba8220d9222ef => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:35.981594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:35.981745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] MFA Rules not processed for user `f4070a106bde4f62a8f5c71bd5d4db85`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:35.982248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:35.982628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:35.983402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:36.013569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:36.015269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:36.068052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 903/1804] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:36.082383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:36.087334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:36.117790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 902/1805] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:36.132466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:36.134444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:36.232676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930778e2-97cd-40bc-a606-3cd9830d0f0e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:36.241662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:36.242345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:36.244877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:36.245202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:36.251691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74159c-e3d0-4000-8503-4e2f572a87a3 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:36.262354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:36.262498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:36.263136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:36.264205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:36.264311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:36.264464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:36.290856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 903/1806] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:37:36.309430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:36.310930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041170ea-fa0a-44db-9a15-5f74428067c7 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:36.345563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 904/1807] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:37.053826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.055403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.071359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f6ae2-ef59-43e9-bd67-565be3db3cf8 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.079202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.081008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.081192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.081543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] PATH_INFO: `/v3/users/d3b41c2c0e434ee7a17d847fac3b197d` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.083924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b41c2c0e434ee7a17d847fac3b197d)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.085709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.163560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b41c2c0e434ee7a17d847fac3b197d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.180211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b41c2c0e434ee7a17d847fac3b197d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.202394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b41c2c0e434ee7a17d847fac3b197d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.203558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b41c2c0e434ee7a17d847fac3b197d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.213205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b41c2c0e434ee7a17d847fac3b197d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.230153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 904/1808] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:37 2022] DELETE /identity/v3/users/d3b41c2c0e434ee7a17d847fac3b197d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:37.236014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.237104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.237614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.250461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.252231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.259298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:37.260635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.340189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 905/1809] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:37.345386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.347216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.360668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc08e7-5cf5-4604-a6ec-778d3b163989 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.366643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.367655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.368342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.368764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] PATH_INFO: `/v3/projects/a4d12e929497402db0f630a96efefc78` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.370207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d12e929497402db0f630a96efefc78)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.372958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.373439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8e8b-aab2-4249-8ab2-b1ea98e1712e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.380068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.381070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.381354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.381630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] PATH_INFO: `/v3/users/2e75ecf75806407fbbe020abe6d354c3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.383113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e75ecf75806407fbbe020abe6d354c3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.385454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.426893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d12e929497402db0f630a96efefc78', 'request_id': 'req-5a67e30f-ae79-4be8-91da-34bf797f802e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.432771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d12e929497402db0f630a96efefc78', 'request_id': 'req-5a67e30f-ae79-4be8-91da-34bf797f802e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.439548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e75ecf75806407fbbe020abe6d354c3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.441914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d12e929497402db0f630a96efefc78', 'request_id': 'req-5a67e30f-ae79-4be8-91da-34bf797f802e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.447564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e75ecf75806407fbbe020abe6d354c3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.457395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] The token cache is being invalidate because project a4d12e929497402db0f630a96efefc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:37.457687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.458736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.460746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 906/1810] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:37 2022] DELETE /identity/v3/projects/a4d12e929497402db0f630a96efefc78 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:37.464326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.464326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.469644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e75ecf75806407fbbe020abe6d354c3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.470374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e75ecf75806407fbbe020abe6d354c3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.480289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3b9a0c98-447f-4bce-95f5-d8bb4729eb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e75ecf75806407fbbe020abe6d354c3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:37.487911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 905/1811] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:37 2022] DELETE /identity/v3/users/2e75ecf75806407fbbe020abe6d354c3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:37.492443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58835a-9d37-4a3f-b577-2a91433f22bb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.492808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58835a-9d37-4a3f-b577-2a91433f22bb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.493192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58835a-9d37-4a3f-b577-2a91433f22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.526443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ca58835a-9d37-4a3f-b577-2a91433f22bb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:37.528069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ca58835a-9d37-4a3f-b577-2a91433f22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.540875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e30f-ae79-4be8-91da-34bf797f802e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.597229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 906/1812] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:37.602880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.605538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.606141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.606484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.606912 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.607256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.607519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.609481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.622145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.623691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.643576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 907/1813] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:37.651909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:37.653216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.662145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 907/1814] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:37.666609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.683745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e745c1-a3a3-453f-9c75-1bc8219228eb service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.695704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.697028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.697028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.697824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.699024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:37.699303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.701075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.714699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 908/1815] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:37.724402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.735840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb694cd-063b-4d65-8b02-8ba9691d08ce None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.742800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.743635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.744086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.744198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.745161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.747794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.805594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 908/1816] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:37 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:37.811552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.826630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c932-75ab-4ff2-9ce7-ff0daaffcf2f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:37.883929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:37.887162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:37.930097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:37.930867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:37.931048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:37.931328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:37.932052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:37.934033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:37.984612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 909/1817] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:37 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:37.990351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.027386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493059d-4537-4b11-b7c5-cba9f1a73652 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.041000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.041786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.042164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.042944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.044205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.049387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.066899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046b3e-5bb0-48a1-a9b1-35d66e6914a2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.071359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 910/1818] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:37:38.071359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.072113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.075260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.075947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.076216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.076484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] PATH_INFO: `/v3/projects/bafbe7581d1a4a5eba4a495797a7c13b` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.077716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafbe7581d1a4a5eba4a495797a7c13b)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.079968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.087925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cba56-40d9-42a5-b432-988204230222 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.096871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.098199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.098199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.098388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] PATH_INFO: `/v3/projects/4673a544aee04895bae7ea3f9d9ef647` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.099622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4673a544aee04895bae7ea3f9d9ef647)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.101755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.167960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafbe7581d1a4a5eba4a495797a7c13b', 'request_id': 'req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.182117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafbe7581d1a4a5eba4a495797a7c13b', 'request_id': 'req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.191261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4673a544aee04895bae7ea3f9d9ef647', 'request_id': 'req-318b851d-3bc2-4294-b3e1-9a146f3c1680'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.198371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4673a544aee04895bae7ea3f9d9ef647', 'request_id': 'req-318b851d-3bc2-4294-b3e1-9a146f3c1680'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.210155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4673a544aee04895bae7ea3f9d9ef647', 'request_id': 'req-318b851d-3bc2-4294-b3e1-9a146f3c1680'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.211227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafbe7581d1a4a5eba4a495797a7c13b', 'request_id': 'req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.233580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] The token cache is being invalidate because project 4673a544aee04895bae7ea3f9d9ef647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:38.234070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.234884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.236670 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] The token cache is being invalidate because project bafbe7581d1a4a5eba4a495797a7c13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:38.236960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.237604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 911/1819] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:38 2022] DELETE /identity/v3/projects/4673a544aee04895bae7ea3f9d9ef647 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:38.239222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.239331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.242471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 909/1820] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:37 2022] DELETE /identity/v3/projects/bafbe7581d1a4a5eba4a495797a7c13b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:38.243610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.245103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.247048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.323582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b851d-3bc2-4294-b3e1-9a146f3c1680 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.329143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.329851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.330283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.330931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.331705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.333623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.333952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a852bb-2e69-4eeb-b8a1-6e95de3c7be0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.341200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.342112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.342388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.342680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] PATH_INFO: `/v3/users/f4070a106bde4f62a8f5c71bd5d4db85` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.344010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4070a106bde4f62a8f5c71bd5d4db85)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.345457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 912/1821] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:38.346489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.350168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.351152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.369383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0c79-8c06-4c50-b5de-59bed43abab4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.374548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.375419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.375698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.375969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] PATH_INFO: `/v3/users/c12457a1e8cb40648fdb5999eb4c276c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.377866 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12457a1e8cb40648fdb5999eb4c276c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.379956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.408446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4070a106bde4f62a8f5c71bd5d4db85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.415681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4070a106bde4f62a8f5c71bd5d4db85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.428990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4070a106bde4f62a8f5c71bd5d4db85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.429751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4070a106bde4f62a8f5c71bd5d4db85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.433440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12457a1e8cb40648fdb5999eb4c276c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.438377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4070a106bde4f62a8f5c71bd5d4db85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.442370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12457a1e8cb40648fdb5999eb4c276c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.443202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12457a1e8cb40648fdb5999eb4c276c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.447727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 910/1822] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:38 2022] DELETE /identity/v3/users/f4070a106bde4f62a8f5c71bd5d4db85 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:38.449271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.450128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.452725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12457a1e8cb40648fdb5999eb4c276c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.466936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7eea980a-f03d-41fb-b23c-910162c70874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12457a1e8cb40648fdb5999eb4c276c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.474818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 913/1823] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:38 2022] DELETE /identity/v3/users/c12457a1e8cb40648fdb5999eb4c276c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:38.547080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87c83-63ff-4729-8e1d-099224344e54 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.620972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.622448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.622768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.623044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] PATH_INFO: `/v3/projects/1da32ead4b8b43b79e6adb4973766289/users/c95507603a8f491da365cfa88eb4648c/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.640088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da32ead4b8b43b79e6adb4973766289, user_id=c95507603a8f491da365cfa88eb4648c, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.646940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.664425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 911/1824] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:38 2022] PUT /identity/v3/projects/1da32ead4b8b43b79e6adb4973766289/users/c95507603a8f491da365cfa88eb4648c/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:38.674486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.674805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.675104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.708326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] MFA Rules not processed for user `c95507603a8f491da365cfa88eb4648c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:38.709623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.743920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.746242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.797413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 914/1825] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:38.798129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.799663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.825500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127b02-cd0c-4a23-9bed-69726854ffe6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.830614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.831691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.832021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.832302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] PATH_INFO: `/v3/projects/5b89656f99db489590be8bfe1020f3b0` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.833916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b89656f99db489590be8bfe1020f3b0)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.836331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.895502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505e480-49a6-4d9c-8b11-e49381c41bc6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:38.899567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b89656f99db489590be8bfe1020f3b0', 'request_id': 'req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.912609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b89656f99db489590be8bfe1020f3b0', 'request_id': 'req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.922363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b89656f99db489590be8bfe1020f3b0', 'request_id': 'req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.933721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] The token cache is being invalidate because project 5b89656f99db489590be8bfe1020f3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:38.934003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.934640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:38.936474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 912/1826] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:38 2022] DELETE /identity/v3/projects/5b89656f99db489590be8bfe1020f3b0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:37:38.937107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:38.938351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:38.953892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:38.954483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.954803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.955080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:38.955780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:38.957698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf48b7-1500-4f28-9921-57e787c09450 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:38.984562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 915/1827] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:38 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:38.984562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:38.984562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:38.984562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.001469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ce91-1eda-4fa7-be62-55ac9ba573c8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.005112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:39.006302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.059217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.060614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.060895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.061150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] PATH_INFO: `/v3/projects/37024c987fe24f79af26e25741b13270` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.062596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37024c987fe24f79af26e25741b13270)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.065148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.065665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 916/1828] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:39.066614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.068219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.081422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201edddc-8d60-4c48-aa6e-348e13edda11 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.087649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.088821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.089335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.090157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.090570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.093434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff56f1-2bd0-4bb0-893a-1c618d811222 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.124741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 917/1829] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:39.126275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736a0c-be57-40c7-919e-2a8d0f27884f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.126717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736a0c-be57-40c7-919e-2a8d0f27884f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.127100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736a0c-be57-40c7-919e-2a8d0f27884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.140308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37024c987fe24f79af26e25741b13270', 'request_id': 'req-5800103a-8e63-4874-b3aa-672607264c85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:39.146370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37024c987fe24f79af26e25741b13270', 'request_id': 'req-5800103a-8e63-4874-b3aa-672607264c85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:39.151186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d7736a0c-be57-40c7-919e-2a8d0f27884f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:39.152448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d7736a0c-be57-40c7-919e-2a8d0f27884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.160710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37024c987fe24f79af26e25741b13270', 'request_id': 'req-5800103a-8e63-4874-b3aa-672607264c85'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:39.177469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] The token cache is being invalidate because project 37024c987fe24f79af26e25741b13270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:39.177687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:39.179050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:39.184520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 913/1830] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:38 2022] DELETE /identity/v3/projects/37024c987fe24f79af26e25741b13270 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:39.184520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.186952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.251920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 918/1831] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:39.255286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.256668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.257315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.277191 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103a-8e63-4874-b3aa-672607264c85 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.279119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:39.280752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.290439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 919/1832] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:39.291256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.291572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.291947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.292228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.292499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.293258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.294917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed90a8e-3867-45cf-a243-886f8e95aa81 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.305255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6074d-7c86-4cc6-a883-96ddca68c47c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.312181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.313579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.313861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.314132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.315055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:39.315362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.320132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 914/1833] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.320319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.320401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.320401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.320908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.333576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 920/1834] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:39.334994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.347720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b721-0ccc-4735-a72a-b9dd252a0d77 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.349894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:39.351271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.354801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.355881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.356254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.356599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] PATH_INFO: `/v3/projects/91425e95d62f45849215ee6818fa8fd0/users/8273e6b82930425ca3e1f16616d997c1/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.360665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 915/1835] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:39.361412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.373493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91425e95d62f45849215ee6818fa8fd0, user_id=8273e6b82930425ca3e1f16616d997c1, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.376285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.383652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c730c-fbb3-41dd-87e1-57c635e2a995 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.390423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.391438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.391774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.392125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.393409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.394466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 921/1836] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:39 2022] PUT /identity/v3/projects/91425e95d62f45849215ee6818fa8fd0/users/8273e6b82930425ca3e1f16616d997c1/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:39.395712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.398421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.451158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 916/1837] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:39.452213 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.496353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763d86-908a-4364-bae6-3cec4a30178b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.519434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3159-950c-45e5-9c8e-bb34dc241743 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.524499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.525310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.525678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.525989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.526838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.528370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.542005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 917/1838] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.542005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.550867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab2e0-b5a2-44c5-88e1-76b94ba1e544 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.555681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.556499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.556775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.557068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.557769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.560256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.563402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.564181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.564532 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.564878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.565748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:39.566165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.567933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.585378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 922/1839] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:39.585573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 918/1840] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:39.585684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.590934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.593994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85b2e-9184-4202-aab9-99cb3444df06 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.599421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.600534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.601064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.601452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] PATH_INFO: `/v3/projects/91425e95d62f45849215ee6818fa8fd0/users/8273e6b82930425ca3e1f16616d997c1/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.601930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc413-00d1-41f3-b617-4f3ac2b63788 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.603880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91425e95d62f45849215ee6818fa8fd0, user_id=8273e6b82930425ca3e1f16616d997c1, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.606775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.607643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.608314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.608594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.608868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.609716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.612366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0ef6b-e9e4-4e0b-9076-0aae8cbceb25 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.626683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 923/1841] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:39 2022] PUT /identity/v3/projects/91425e95d62f45849215ee6818fa8fd0/users/8273e6b82930425ca3e1f16616d997c1/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:39.626683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.653531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 919/1842] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:39.653531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.653531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.653531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.679475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] MFA Rules not processed for user `8273e6b82930425ca3e1f16616d997c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:39.680728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.695870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18893c-39b6-48ef-a330-733e10511210 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.744639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 920/1843] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:39.745464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.753259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.753922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.754476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.754874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.755615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.757286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.767223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 924/1844] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.768163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.770107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.805702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ca51-656e-40f1-9cd0-c95eda5b3677 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.810973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.810973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.811266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.811539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.812245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.814452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.823462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c6a8-d574-4a9e-85f6-358ebc5c9b91 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.827689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.828255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.828538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.828828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.830947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:39.841563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 921/1845] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:39.842604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.854021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71e5f-024f-401b-9982-99e1ce28d8e0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.859597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.860260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.860538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.860805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.861547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.863209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.876874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 922/1846] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.876874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.884134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149340-f652-4467-8d5e-816f03537703 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.888835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.889467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.889749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.890020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.890794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.892377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.897027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.898607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.905562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 923/1847] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.905562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.907990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 925/1848] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:39.908793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.919555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc502-278f-4bf7-91de-06167702f723 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.919930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09aa-1e98-49c2-9131-987f6032e87a service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.926746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.928613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.929163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.929577 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] PATH_INFO: `/v3/projects/c63d08c3d7444191be938fb88753524f/users/2959d6d0ed3843b9bb60cc1826e778c6/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.932956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.933648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.933924 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.934206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.934969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.936700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.948557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 926/1849] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:39.953187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:39.956634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63d08c3d7444191be938fb88753524f, user_id=2959d6d0ed3843b9bb60cc1826e778c6, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:39.961823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde74a02-70ff-4916-841d-8a53b4f1338d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:39.968896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f042db-01a2-4bbc-89c2-3e3f55d87782 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:39.974594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:39.975865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.976434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.976812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] PATH_INFO: `/v3/projects/5cc01a80feb849e9ac116403fd3e06f0/users/15d55cf33c4e45f9aaf69dde05080999/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:39.981994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 924/1850] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:39 2022] PUT /identity/v3/projects/c63d08c3d7444191be938fb88753524f/users/2959d6d0ed3843b9bb60cc1826e778c6/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:39.993326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:39.993978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:39.994567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:40.002262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc01a80feb849e9ac116403fd3e06f0, user_id=15d55cf33c4e45f9aaf69dde05080999, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:40.005271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e1d43-5ab2-48b6-b58b-ef71819f4789 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:40.031124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 927/1851] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:39 2022] PUT /identity/v3/projects/5cc01a80feb849e9ac116403fd3e06f0/users/15d55cf33c4e45f9aaf69dde05080999/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:40.035615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:40.036123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:40.036598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] MFA Rules not processed for user `2959d6d0ed3843b9bb60cc1826e778c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:40.036818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:40.038410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:40.069547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] MFA Rules not processed for user `15d55cf33c4e45f9aaf69dde05080999`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:40.071620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:40.135025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 925/1852] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:40.147411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:40.150058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:40.157340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 928/1853] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:40.201021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:40.211017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9763cc4-ac2a-4bbb-b695-7657faf56d96 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:40.212120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1b3c6-5fee-49b6-979d-21897593c4bb None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:40.215365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:40.216011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:40.216296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:40.216628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:40.217530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:40.218364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:40.218728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:40.219194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:40.226011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:40.227516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfbddd-fa33-47a9-b2f6-3c20c94afc8d service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:40.230100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:40.230933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146537ac-f4b2-4c66-8e9e-8ca3e1154131 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:40.237503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 926/1854] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:40.240907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 929/1855] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:37:44.442403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:44.443035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:44.443193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:44.445103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 927/1856] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:37:44.465075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:44.465649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:44.465649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:44.489556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:44.490846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:44.580891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 930/1857] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:37:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:44.711252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:44.714205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:44.733144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75026-57eb-4e29-a534-e33302c922b6 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:44.739616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:44.740459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:44.740883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:44.741307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:44.751305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:44.752883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c98b-4333-4649-b9e1-d4be30efbdd3 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:44.763273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 928/1858] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:53.914476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:53.986844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55faa2-6149-4ee1-a478-91086ee0e919 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:53.993545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:53.994589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:53.995059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:53.995425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] PATH_INFO: `/v3/users/c95507603a8f491da365cfa88eb4648c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:53.997745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95507603a8f491da365cfa88eb4648c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:53.999607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:54.050273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95507603a8f491da365cfa88eb4648c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.061358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95507603a8f491da365cfa88eb4648c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.062203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95507603a8f491da365cfa88eb4648c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.069823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95507603a8f491da365cfa88eb4648c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.081185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95507603a8f491da365cfa88eb4648c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.088588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 931/1859] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:53 2022] DELETE /identity/v3/users/c95507603a8f491da365cfa88eb4648c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:54.094222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:54.094731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:54.094849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:54.117864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:54.119171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:54.181963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 929/1860] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:54.194400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:54.195908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:54.259531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1efad9-89f7-4f4b-b130-3aff2e96edca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:54.263529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:54.264322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:54.264608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:54.266381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:54.284618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:54.286257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:54.301084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 932/1861] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:54.656891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:54.658385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:54.670610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8c79-f8cf-4047-a766-a0eac5648b33 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:54.676320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:54.677548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:54.677826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:54.678095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] PATH_INFO: `/v3/projects/1da32ead4b8b43b79e6adb4973766289` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:54.679351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da32ead4b8b43b79e6adb4973766289)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:54.681427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:54.738454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da32ead4b8b43b79e6adb4973766289', 'request_id': 'req-603c088d-993f-45c0-a281-c8bcd4fdfd02'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.744074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da32ead4b8b43b79e6adb4973766289', 'request_id': 'req-603c088d-993f-45c0-a281-c8bcd4fdfd02'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.753391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da32ead4b8b43b79e6adb4973766289', 'request_id': 'req-603c088d-993f-45c0-a281-c8bcd4fdfd02'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.766325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] The token cache is being invalidate because project 1da32ead4b8b43b79e6adb4973766289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:54.766632 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.767305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.772143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 930/1862] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:54 2022] DELETE /identity/v3/projects/1da32ead4b8b43b79e6adb4973766289 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:54.773588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:54.784404 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f072-5480-4235-811d-74f1f0e82ef2 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:54.844391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:54.845286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:54.845563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:54.845840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] PATH_INFO: `/v3/users/8273e6b82930425ca3e1f16616d997c1` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:54.847106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8273e6b82930425ca3e1f16616d997c1)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:54.849141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:54.896719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8273e6b82930425ca3e1f16616d997c1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.904478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8273e6b82930425ca3e1f16616d997c1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.905181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8273e6b82930425ca3e1f16616d997c1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.912437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8273e6b82930425ca3e1f16616d997c1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.926808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-922cee34-4e69-4842-baa4-a6fd63239108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8273e6b82930425ca3e1f16616d997c1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:54.934751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 933/1863] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:54 2022] DELETE /identity/v3/users/8273e6b82930425ca3e1f16616d997c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:55.237945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:55.239674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:55.253231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c088d-993f-45c0-a281-c8bcd4fdfd02 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:55.318841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cad14-3162-4333-a334-08920a395304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:55.319861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cad14-3162-4333-a334-08920a395304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.320142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cad14-3162-4333-a334-08920a395304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.320427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cad14-3162-4333-a334-08920a395304 admin admin] PATH_INFO: `/v3/projects/91425e95d62f45849215ee6818fa8fd0` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.321740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cad14-3162-4333-a334-08920a395304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91425e95d62f45849215ee6818fa8fd0)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:55.323840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cad14-3162-4333-a334-08920a395304 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:55.372561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91425e95d62f45849215ee6818fa8fd0', 'request_id': 'req-661cad14-3162-4333-a334-08920a395304'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.379960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91425e95d62f45849215ee6818fa8fd0', 'request_id': 'req-661cad14-3162-4333-a334-08920a395304'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.389306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91425e95d62f45849215ee6818fa8fd0', 'request_id': 'req-661cad14-3162-4333-a334-08920a395304'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.404615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] The token cache is being invalidate because project 91425e95d62f45849215ee6818fa8fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:55.404913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.405873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.408433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 931/1864] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:55 2022] DELETE /identity/v3/projects/91425e95d62f45849215ee6818fa8fd0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:55.413506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8ea9-89e3-4139-8f2e-46ae4a89ab83 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.414804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8ea9-89e3-4139-8f2e-46ae4a89ab83 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.415289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8ea9-89e3-4139-8f2e-46ae4a89ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.463319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-253f8ea9-89e3-4139-8f2e-46ae4a89ab83 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:55.465261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-253f8ea9-89e3-4139-8f2e-46ae4a89ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:55.467626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:55.469624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:55.547786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 934/1865] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:55.556917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.557228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.557526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.580708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:55.582151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:55.598424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 935/1866] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:55.599527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:55.622826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cad14-3162-4333-a334-08920a395304 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:55.627549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:55.628539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801e28b-1f97-4ebe-979a-f73c6e2f23ac None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:55.628630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.628772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.629738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] PATH_INFO: `/v3/users/15d55cf33c4e45f9aaf69dde05080999` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.631085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d55cf33c4e45f9aaf69dde05080999)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:55.636499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:55.637408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.637817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.638298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.639360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:55.639842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:55.641918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:55.645564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:55.662349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 936/1867] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:55.663510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:55.689712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d69a-cc50-4ff6-a450-427992e34ee1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:55.695377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:55.696261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.696646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.697110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.698570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:55.700706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:55.762878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 937/1868] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:55 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:55.764062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:55.765488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d55cf33c4e45f9aaf69dde05080999'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.789678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d55cf33c4e45f9aaf69dde05080999'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.842461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d55cf33c4e45f9aaf69dde05080999'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.848690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d55cf33c4e45f9aaf69dde05080999'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.875968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-23f3376f-574f-4113-a679-9d04527549c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d55cf33c4e45f9aaf69dde05080999'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:55.890604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 932/1869] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:37:55 2022] DELETE /identity/v3/users/15d55cf33c4e45f9aaf69dde05080999 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:55.896121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466481-3506-4581-afb9-3473265e1dda None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.896415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466481-3506-4581-afb9-3473265e1dda None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.896728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466481-3506-4581-afb9-3473265e1dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.904805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292060c-5152-489f-ac45-6925f5201580 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:55.958232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f8466481-3506-4581-afb9-3473265e1dda None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:55.962032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f8466481-3506-4581-afb9-3473265e1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:55.987232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:55.987985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:55.988345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:55.988531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:55.990088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:55.993856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.074373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 938/1870] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:55 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:37:56.075520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.081448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:56.104612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d0aa3-e1e1-42b1-b262-138e8467c8fb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.115072 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.115774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.116060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.116335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.118317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.122940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.162895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 939/1871] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:56.170000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.170169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 933/1872] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:56.176293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466481-3506-4581-afb9-3473265e1dda None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.179023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f8466481-3506-4581-afb9-3473265e1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:56.183264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597d25-5890-4a0a-aa3e-e30e7060b0da admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.195104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.196234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.196440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.196720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.199147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.203258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.226448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 940/1873] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:56.231922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.256373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e2e2-34a5-4368-a122-0e56ee8a714e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.266638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.267700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.267987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.268316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] PATH_INFO: `/v3/projects/b06a4f01fa8941679c637967d163a9dd/users/2cc101773e2e49a0961c5a117044dcfe/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.281028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466481-3506-4581-afb9-3473265e1dda None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.285548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.286247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.286528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.286869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.292632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06a4f01fa8941679c637967d163a9dd, user_id=2cc101773e2e49a0961c5a117044dcfe, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.297731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a933e-48d7-4320-9a8b-1b0d46480db3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.298628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.310893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.322645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 941/1874] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:56 2022] PUT /identity/v3/projects/b06a4f01fa8941679c637967d163a9dd/users/2cc101773e2e49a0961c5a117044dcfe/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:56.334477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.335136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.335513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.344685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 934/1875] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:56.441004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] MFA Rules not processed for user `2cc101773e2e49a0961c5a117044dcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:56.442349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:56.608892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 942/1876] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:56.622136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.623605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:56.729114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdb3e-b179-4ce8-9dcb-433cacfac5c6 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.816852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.817658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.818071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.818523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.829399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.831777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee2b0-13d2-4855-852b-14392ac3a73a service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:56.848801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 935/1877] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:37:56.867605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:56.868884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:56.955938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f44c-25dc-4772-b968-3112a7f6527e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:56.968778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:56.969687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:56.969971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:56.970247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] PATH_INFO: `/v3/projects/5cc01a80feb849e9ac116403fd3e06f0` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:56.971682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc01a80feb849e9ac116403fd3e06f0)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:56.973774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.029475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc01a80feb849e9ac116403fd3e06f0', 'request_id': 'req-bc451995-255e-496e-886c-b7034a72f41d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:57.037314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc01a80feb849e9ac116403fd3e06f0', 'request_id': 'req-bc451995-255e-496e-886c-b7034a72f41d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:57.046602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc01a80feb849e9ac116403fd3e06f0', 'request_id': 'req-bc451995-255e-496e-886c-b7034a72f41d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:57.058216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] The token cache is being invalidate because project 5cc01a80feb849e9ac116403fd3e06f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:37:57.058385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:57.059198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-bc451995-255e-496e-886c-b7034a72f41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:37:57.060853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 943/1878] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:37:56 2022] DELETE /identity/v3/projects/5cc01a80feb849e9ac116403fd3e06f0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:57.067011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.067374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.067727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.087199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:57.088212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:57.168007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 936/1879] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:57.181426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.181710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.181990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.206890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:57.208644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:57.223977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 944/1880] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:37:57.227118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.241538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5725092-6f2a-4cba-84d7-a787b74089db None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.256510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.257232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.257534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.257786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.258636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:37:57.259107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.260580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.275082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 937/1881] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:37:57.279150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.289305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720225c9-3218-464c-9875-c2a88600e5a6 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.296100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.296973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.297231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.297509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.298222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.301828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.348729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 945/1882] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:37:57 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:57.353762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.381299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5328-80b4-4ef5-8353-c550076c6ca8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.457875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.458866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.459280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.459701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.460561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.462747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.490275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 938/1883] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:37:57 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:37:57.494836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.517315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3425c-6a91-45f2-a2ab-f01c893b6d9d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.531462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.532414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.532795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.533591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.534415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.536342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.570761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 946/1884] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:57.574328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.588620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5554d32-053b-4016-a73c-8e4f6229efee admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.596539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.597759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.598124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.598608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.599712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.607672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c0cb-8178-467d-91dc-c2eafe0d6bf1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.621100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 939/1885] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:37:57.624590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.640421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5a03-263a-4e06-8e42-4dbed155a60f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.647945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.649060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.649381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.649661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] PATH_INFO: `/v3/projects/40bfef4d74674be08aca4f965b2c2166/users/53ecdf0e91ea4289bbc145d4c0970795/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.671890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfef4d74674be08aca4f965b2c2166, user_id=53ecdf0e91ea4289bbc145d4c0970795, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.675332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.702486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 947/1886] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:37:57 2022] PUT /identity/v3/projects/40bfef4d74674be08aca4f965b2c2166/users/53ecdf0e91ea4289bbc145d4c0970795/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:37:57.706840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f7a9-57bb-4e45-a05d-3d5243b17896 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.707316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f7a9-57bb-4e45-a05d-3d5243b17896 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.707597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f7a9-57bb-4e45-a05d-3d5243b17896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.738872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b853f7a9-57bb-4e45-a05d-3d5243b17896 None None] MFA Rules not processed for user `53ecdf0e91ea4289bbc145d4c0970795`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:37:57.740172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b853f7a9-57bb-4e45-a05d-3d5243b17896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:57.807917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 940/1887] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:37:57.817808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:37:57.819630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:37:57.886342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2406a1-f221-4b9a-bf4f-03ed1af6c92b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:37:57.891159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:37:57.891831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:37:57.892198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:37:57.892489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:37:57.907926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:37:57.909616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:37:57.926161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 948/1888] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:37:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:02.644693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48bf-2180-4b45-af11-6e05996bf382 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:02.644693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48bf-2180-4b45-af11-6e05996bf382 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:02.644693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48bf-2180-4b45-af11-6e05996bf382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:02.678761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e44d48bf-2180-4b45-af11-6e05996bf382 None None] MFA Rules not processed for user `53ecdf0e91ea4289bbc145d4c0970795`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:02.680184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e44d48bf-2180-4b45-af11-6e05996bf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:02.695485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 941/1889] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:05.588394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:05.591148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:05.716497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5633-d0fb-469d-8fa7-ebde7afdcec6 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:05.721217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:05.722146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:05.722405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:05.722705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] PATH_INFO: `/v3/users/2cc101773e2e49a0961c5a117044dcfe` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:05.724645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc101773e2e49a0961c5a117044dcfe)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:05.726800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:05.780497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc101773e2e49a0961c5a117044dcfe'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:05.791937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc101773e2e49a0961c5a117044dcfe'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:05.792621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc101773e2e49a0961c5a117044dcfe'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:05.805660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc101773e2e49a0961c5a117044dcfe'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:05.828169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc101773e2e49a0961c5a117044dcfe'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:05.836021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 949/1890] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:05 2022] DELETE /identity/v3/users/2cc101773e2e49a0961c5a117044dcfe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:05.844866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:05.845895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:05.846398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:05.881686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:05.884123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:05.967699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 942/1891] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:05.974441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:05.976107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:06.068119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312c1d-46c2-4999-9dcf-7d2ce5534d40 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:06.079079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:06.079772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:06.080054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:06.080391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:06.094411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:06.096162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfecf1-12b5-45d6-a6ed-1ca5f8bb6c91 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:06.109501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 950/1892] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:06.760910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:06.764892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:06.787565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d896e-857b-4852-a433-87c11d8f5bf9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:06.802675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:06.803671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:06.804461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:06.805087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] PATH_INFO: `/v3/projects/b06a4f01fa8941679c637967d163a9dd` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:06.807043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06a4f01fa8941679c637967d163a9dd)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:06.809187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:06.868834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06a4f01fa8941679c637967d163a9dd', 'request_id': 'req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:06.881364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06a4f01fa8941679c637967d163a9dd', 'request_id': 'req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:06.902274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06a4f01fa8941679c637967d163a9dd', 'request_id': 'req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:06.914580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] The token cache is being invalidate because project b06a4f01fa8941679c637967d163a9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:06.915036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:06.915881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-db4dd96a-f431-4cb0-b4e9-ffb9d00b504a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:06.917563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 943/1893] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:06 2022] DELETE /identity/v3/projects/b06a4f01fa8941679c637967d163a9dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:06.922987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:06.923629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:06.923983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:06.943506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:06.945095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:07.019103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 951/1894] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:07.026811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.027307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.027790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.064816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:07.066188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:07.075711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 944/1895] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:07.080092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.092165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9281e-5b92-484a-a9bb-3b46d13149cd None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.097629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.098629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.099171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.099598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.100511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:07.100971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.103030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.120230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 952/1896] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:38:07.125013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.143592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef75d21-11a4-4859-9161-c3fea9b8c8cc None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.148980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.149738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.150083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.150350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.151285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.155560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.197041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 945/1897] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:07.197792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.212169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed89cb-403f-402c-9d09-f813136d4bdd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.341146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.341850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.342130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.342400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.343199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.345148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.404215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 953/1898] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:07.406908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.425222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d64536-42d2-401a-941d-da7eb790d009 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.435743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.436776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.437189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.444532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.447126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.463999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.495900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 946/1899] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:07.496955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.513230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72396e-5a90-40a5-8cea-266d3a524d48 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.527878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.529679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.531036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.532032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.533563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.538478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819016-906f-4ebe-b59b-f00effd49f4a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.572336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 954/1900] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:07.573745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.589598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b310d2-d6a0-4861-8257-7b4d11ab419f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.606918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.608176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.608575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.609603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] PATH_INFO: `/v3/projects/fbe911535191450099be7f5b922d951d/users/6d31da2c36364a9bace41359eb8efcd1/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.663028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe911535191450099be7f5b922d951d, user_id=6d31da2c36364a9bace41359eb8efcd1, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.675101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.718098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 947/1901] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:07 2022] PUT /identity/v3/projects/fbe911535191450099be7f5b922d951d/users/6d31da2c36364a9bace41359eb8efcd1/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:07.729595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.729879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.730150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.766207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] MFA Rules not processed for user `6d31da2c36364a9bace41359eb8efcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:07.767473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:07.845011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 955/1902] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:07.846683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.919693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e538cc8-bb7d-447a-94e0-ccedd8286ec3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:07.925216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:07.926717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:07.927181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:07.927598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:07.928476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:07.930596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:07.974765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 948/1903] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:07.978350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:07.989128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdfcf-8a53-4cc4-9571-5868503209df None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.086579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.087742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.088019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.088497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.090043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.093923 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.150093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 956/1904] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:07 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:08.151067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.167637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec6f7-eeeb-4eba-93d2-d4cfec1a6c10 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.180986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.182036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.182798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.183360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.184355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.186397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.212099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 949/1905] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:08.213863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.226228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95ed5-de61-4577-bc95-5aec5e3b3ad0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.233862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.236791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.237224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.237511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.238435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.240564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b0076-33c1-4331-9e5c-cf5df509e3e1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.256300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 957/1906] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:08.257624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.270784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7132cec-0722-4594-90a9-6337f0379cc1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.278436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.279378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.279655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.279923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] PATH_INFO: `/v3/projects/6f8c9a9fb9794b2aa49611e8f3176f10/users/f6a262c0fac64b869220194a4eda2098/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.300430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8c9a9fb9794b2aa49611e8f3176f10, user_id=f6a262c0fac64b869220194a4eda2098, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.304281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.323612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 950/1907] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:08 2022] PUT /identity/v3/projects/6f8c9a9fb9794b2aa49611e8f3176f10/users/f6a262c0fac64b869220194a4eda2098/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:08.333687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.334236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.334677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.369719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] MFA Rules not processed for user `f6a262c0fac64b869220194a4eda2098`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:08.371975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:08.458508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 958/1908] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:08.463355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.531871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dc464-da01-41b6-8655-de755db98e3e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.536706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.537371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.537655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.537985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.538947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.540779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.567958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 951/1909] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:08 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:08.571881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.584141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044667a2-9ea0-4bb7-8efb-cb06f6ac2835 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.645972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.646877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.647159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.647431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.648228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.650263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.677757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 959/1910] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:08 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:08.681967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.697315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d693590-1045-466c-b999-2fbad4ad6dbf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.702417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.703238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.703615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.703974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.704819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.706585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.718300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 952/1911] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:08.722350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.733809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d4a0-0da4-4e5e-8af1-af20c65416eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.759784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.760946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.761430 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.761835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] PATH_INFO: `/v3/projects/87304169b9d84b8b9b2cb4de18abc38e/users/16a40d9dc90749199d563222142818bb/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.781830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87304169b9d84b8b9b2cb4de18abc38e, user_id=16a40d9dc90749199d563222142818bb, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.785386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.806342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 960/1912] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:08 2022] PUT /identity/v3/projects/87304169b9d84b8b9b2cb4de18abc38e/users/16a40d9dc90749199d563222142818bb/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:08.812100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.835518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b52971-55fe-49cd-abb0-62c321a75d9e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:08.899483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.901858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:08.952710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:08.953523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:08.953894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:08.954259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:08.955133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:08.956854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:08.972476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 953/1913] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:08.973936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:08.988947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37725ff-3456-4aa6-b392-24e204fc74fe admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.006414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.007837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.008314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.008836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] PATH_INFO: `/v3/projects/87304169b9d84b8b9b2cb4de18abc38e/users/16a40d9dc90749199d563222142818bb/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.012354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87304169b9d84b8b9b2cb4de18abc38e, user_id=16a40d9dc90749199d563222142818bb, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.019417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fea3b-a064-4882-969c-a73fb8e0e604 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.060423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 954/1914] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:08 2022] PUT /identity/v3/projects/87304169b9d84b8b9b2cb4de18abc38e/users/16a40d9dc90749199d563222142818bb/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:09.060423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.060423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.060423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.067042 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365876-99e2-441a-968f-4af27eac3797 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.098898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] MFA Rules not processed for user `16a40d9dc90749199d563222142818bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:09.103123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.183343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.184677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.185233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.185647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] PATH_INFO: `/v3/users/2959d6d0ed3843b9bb60cc1826e778c6` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.187293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2959d6d0ed3843b9bb60cc1826e778c6)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.191110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.230841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 955/1915] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:09.241189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:09.242630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.307127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2959d6d0ed3843b9bb60cc1826e778c6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.322111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2959d6d0ed3843b9bb60cc1826e778c6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.323146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2959d6d0ed3843b9bb60cc1826e778c6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.335223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2959d6d0ed3843b9bb60cc1826e778c6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.354001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee7d0784-1db8-4a8c-aaf3-f25f332042c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2959d6d0ed3843b9bb60cc1826e778c6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.364000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8957-2185-4fd7-a66a-6973a4e12415 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.366297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 961/1916] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:08 2022] DELETE /identity/v3/users/2959d6d0ed3843b9bb60cc1826e778c6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:09.368245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.368606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.368952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.408021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:09.409265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.468560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.469218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.469492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.469760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.471750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.525522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 962/1917] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:09.526583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:09.530546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.549970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cea487-3c95-45c6-8718-911cc3404041 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.567019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.567788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.568070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.568341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] PATH_INFO: `/v3/users/18c5fda004b744f9b2c3a73bb090f05d` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.570333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c5fda004b744f9b2c3a73bb090f05d)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.572504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.590322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.591909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.602462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 956/1918] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:09.603532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:09.604839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.681525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c5fda004b744f9b2c3a73bb090f05d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.695367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c5fda004b744f9b2c3a73bb090f05d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.696180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c5fda004b744f9b2c3a73bb090f05d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.709106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c5fda004b744f9b2c3a73bb090f05d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.711854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ef3b-47b4-4a74-bedb-7732fa4454f6 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.735077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.735077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.735077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.735077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.735397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7e683e5e-8968-4097-92be-cd3f94e4be7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c5fda004b744f9b2c3a73bb090f05d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:09.736475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 963/1919] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:09 2022] DELETE /identity/v3/users/18c5fda004b744f9b2c3a73bb090f05d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:09.741306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.741571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.741853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.743979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.749058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.760453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 957/1920] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:09.763651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:09.765817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.832998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 964/1921] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:09.844591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:09.846321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:09.858126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3923-779c-4b34-975e-151bbc13963e service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:09.911516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:09.912331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:09.912810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:09.913310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:09.930767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:09.930767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efc78-b3f3-4918-a09d-e952e139d337 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:09.946390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 958/1922] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:10.185948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.187297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.200187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1506a-a9ef-446c-b2f6-cd273cc97aee None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.206375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.207365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.207642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.208080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] PATH_INFO: `/v3/projects/c63d08c3d7444191be938fb88753524f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.209725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63d08c3d7444191be938fb88753524f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.212246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.270418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63d08c3d7444191be938fb88753524f', 'request_id': 'req-08c76b37-b46a-4bdd-8cda-f99a1925011a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.276749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63d08c3d7444191be938fb88753524f', 'request_id': 'req-08c76b37-b46a-4bdd-8cda-f99a1925011a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.284628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63d08c3d7444191be938fb88753524f', 'request_id': 'req-08c76b37-b46a-4bdd-8cda-f99a1925011a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.300014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] The token cache is being invalidate because project c63d08c3d7444191be938fb88753524f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:10.300603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.301460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.303441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 965/1923] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:10 2022] DELETE /identity/v3/projects/c63d08c3d7444191be938fb88753524f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:10.308826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152c73-01a4-444d-ac57-ffb40952cf4e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.309352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152c73-01a4-444d-ac57-ffb40952cf4e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.309352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152c73-01a4-444d-ac57-ffb40952cf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.328009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-be152c73-01a4-444d-ac57-ffb40952cf4e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:10.329289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-be152c73-01a4-444d-ac57-ffb40952cf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.330977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.332555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.391884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 959/1924] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:10.398729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b37-b46a-4bdd-8cda-f99a1925011a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.399729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.400021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.400329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.403566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.404443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.404728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.405005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] PATH_INFO: `/v3/projects/6ce6424c3d084b128a81594bd2862f54` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.406198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce6424c3d084b128a81594bd2862f54)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.408311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.419132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:10.420329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.428844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 960/1925] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:10.432998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.442037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec0d61-c117-42be-8b70-0ad9e611efd4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.446730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.447327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.447639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.447902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.448642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:10.448940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.450543 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.456330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce6424c3d084b128a81594bd2862f54', 'request_id': 'req-50435d1c-e924-436f-a61b-f4f00ffcd607'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.461906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 961/1926] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:38:10.462047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce6424c3d084b128a81594bd2862f54', 'request_id': 'req-50435d1c-e924-436f-a61b-f4f00ffcd607'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.466321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.470485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce6424c3d084b128a81594bd2862f54', 'request_id': 'req-50435d1c-e924-436f-a61b-f4f00ffcd607'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.476446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6237ad-b851-43c5-811a-419b742d98e1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.483398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] The token cache is being invalidate because project 6ce6424c3d084b128a81594bd2862f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:10.483779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.484609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.489731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 966/1927] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:10 2022] DELETE /identity/v3/projects/6ce6424c3d084b128a81594bd2862f54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:10.491022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.492706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.547077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.547671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.548073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.548427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.549197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.551197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.566201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435d1c-e924-436f-a61b-f4f00ffcd607 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.572384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.573394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.573682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.574039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] PATH_INFO: `/v3/users/eb383bcbfb154aaf85e889519201e98b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.575372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb383bcbfb154aaf85e889519201e98b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.584644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.587377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 962/1928] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:10 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:10.591900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.593712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.655121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb383bcbfb154aaf85e889519201e98b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.669311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb383bcbfb154aaf85e889519201e98b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.670254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb383bcbfb154aaf85e889519201e98b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.670549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b395-2396-4828-9264-6a2cd1a6fc97 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.676358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.677067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.677329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.677605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.678316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.679140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb383bcbfb154aaf85e889519201e98b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.680335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.692446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb383bcbfb154aaf85e889519201e98b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:10.701221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 967/1929] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:10 2022] DELETE /identity/v3/users/eb383bcbfb154aaf85e889519201e98b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:10.705531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 963/1930] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:10 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:10.709647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.711160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:10.802711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d0e3c-2a34-46b9-80b0-ec1b14949f3e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.809158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.810078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.810519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.810981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.811982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.813606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.827182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 968/1931] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:10.831245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.843266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bad62-f8f3-4670-bee6-d7cc52494cf9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.848395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.849199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.849612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.849951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.852076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.853007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1e847-2082-4b74-a9ed-c04df2e309d5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.864255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 964/1932] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:10.869066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:10.879771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb664-d5b6-4adb-81d6-9f6a8b2a41f2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:10.886161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:10.887137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.887418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.887692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] PATH_INFO: `/v3/projects/b5f20a9d15eb4d99bf667578a36a9f55/users/30c4ac1332b64a648d7214918f757f83/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.905032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f20a9d15eb4d99bf667578a36a9f55, user_id=30c4ac1332b64a648d7214918f757f83, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:10.907894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:10.928991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 969/1933] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:10 2022] PUT /identity/v3/projects/b5f20a9d15eb4d99bf667578a36a9f55/users/30c4ac1332b64a648d7214918f757f83/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:10.934294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:10.934892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:10.935237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:10.953615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:10.954943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.020007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 965/1934] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:11.038423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.040477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.131568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985acc63-a765-4d69-ba62-bd4bfc2cf97e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.147781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.149853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.150142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.150470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.158092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.160343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.170336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.171878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.177541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc410e-5f66-4725-a48f-5e5527088060 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.183964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 970/1935] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:11.201959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.202893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.203174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.203446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] PATH_INFO: `/v3/projects/4c31224eaee34362932f13752c39fcb2` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.204752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c31224eaee34362932f13752c39fcb2)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.206677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.244159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.245776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.266361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c31224eaee34362932f13752c39fcb2', 'request_id': 'req-2fa2f9af-c1f5-4dff-960c-e7919250ab01'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:11.272723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c31224eaee34362932f13752c39fcb2', 'request_id': 'req-2fa2f9af-c1f5-4dff-960c-e7919250ab01'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:11.281043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c31224eaee34362932f13752c39fcb2', 'request_id': 'req-2fa2f9af-c1f5-4dff-960c-e7919250ab01'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:11.296056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] The token cache is being invalidate because project 4c31224eaee34362932f13752c39fcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:11.296056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:11.296817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2fa2f9af-c1f5-4dff-960c-e7919250ab01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:11.298570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 966/1936] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:11 2022] DELETE /identity/v3/projects/4c31224eaee34362932f13752c39fcb2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:11.303657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98a1d7-121d-4fb9-a203-5a49b0c4d726 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.304069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98a1d7-121d-4fb9-a203-5a49b0c4d726 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.304855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98a1d7-121d-4fb9-a203-5a49b0c4d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.313353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f164019-b7d2-4ace-b8ab-d8c68155b515 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.331616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-da98a1d7-121d-4fb9-a203-5a49b0c4d726 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:11.332875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-da98a1d7-121d-4fb9-a203-5a49b0c4d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.372501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.373176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.373459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.373732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.375867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.410697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 967/1937] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:11.418623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.419183 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.419677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.437153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.438634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.441761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:11.442987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.448997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 971/1938] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:11.453961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 968/1939] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:11.458075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.474700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acd9e6-e6e7-4b32-bf9f-865979ba02f3 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.480037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.480884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.481665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.481665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.483013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:11.483387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.485302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.503576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 972/1940] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:11.505176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.522303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2da380-db0c-44c9-ae0b-1bc387fb784f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.529701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.531046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.531448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.531815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.532683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.536065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.594969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 969/1941] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:11.599639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.614340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3564bb-81fb-4e66-92ac-8ced4338447b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.692984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.694509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.694978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.695990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.696907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.699137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.732440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 973/1942] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:11.733831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.751210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39fb2-3c80-4f2a-b76b-550720735ad0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.757750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.758660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.759035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.759366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.760225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.762273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.782699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.783634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 970/1943] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:11.802152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694295a-11d0-4c33-8586-aefaa7ab31fa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.811738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.812746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.813209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.813950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.814997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.816974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b7230-b636-45cd-9b81-1404a751cfe0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.832084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 974/1944] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:11.836926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:11.849339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc6276-575c-4ecc-829e-70412c6e434a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:11.854234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:11.855237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.855584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.855923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] PATH_INFO: `/v3/projects/521b58e60a6b4598bd657ef78e2e3d64/users/aae8d049fdee4c4cbb7ea54557e8017e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.874710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=521b58e60a6b4598bd657ef78e2e3d64, user_id=aae8d049fdee4c4cbb7ea54557e8017e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:11.877895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d39bde-bd6e-4352-8591-12f076046d6f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:11.894493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 971/1945] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:11 2022] PUT /identity/v3/projects/521b58e60a6b4598bd657ef78e2e3d64/users/aae8d049fdee4c4cbb7ea54557e8017e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:11.907223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.907512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.907819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:11.946381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] MFA Rules not processed for user `aae8d049fdee4c4cbb7ea54557e8017e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:11.948014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:11.981614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:11.982249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:11.982589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.016703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] MFA Rules not processed for user `30c4ac1332b64a648d7214918f757f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:12.018984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:12.062471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 975/1946] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:12.066790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.100520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 972/1947] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:12.106613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.108129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:12.149405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbade5f7-eb39-4d9b-8306-f5d89e4b7a9f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.159244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.160036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.160327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.160605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.161336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.163828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.213084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 976/1948] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:12 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:12.222934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.230568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7398d-0192-43b6-84d9-e6bf36be544b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.301195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.301872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.302563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.302563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.309881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b97e-598f-4efe-8397-fd1e5dc563eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.320043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.321090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.321547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.321821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.322593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.324607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.350177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 977/1949] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:12 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:12.351306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.354320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:12.370429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71a11e-3f7c-4540-81d2-f7f921ae95aa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.375641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.376397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.376784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.377107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.379225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:12.391306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.393409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.405571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 973/1950] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:12.408207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.433959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a87aed-10d5-47ee-989b-b9f1265026b0 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.445418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.447047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.447526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.448151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.449865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.453637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.459307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.461352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.474921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 974/1951] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:12.476527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 978/1952] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:12.479418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.489645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d5f4d-c43b-485f-ae8a-3cf5227d554d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.496811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.497956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.498219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.498486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] PATH_INFO: `/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968/users/da0516a18b35400d82293fecb26eef97/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.515777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dafc9e9684d4d7f950fe2e58a32c968, user_id=da0516a18b35400d82293fecb26eef97, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.520637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.536473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 975/1953] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:12 2022] PUT /identity/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968/users/da0516a18b35400d82293fecb26eef97/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:12.540474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.550977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc124c-71e5-4046-9fc5-f1a03b2494c4 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.632143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.632985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.633459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.633604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.634358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.636054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb441c-6940-4401-ba1a-015c3273d59b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.650115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 979/1954] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:12.652086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.669056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb763-e522-4d4a-8b40-87d20e761651 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.677362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.678500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.678611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.678836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] PATH_INFO: `/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968/users/da0516a18b35400d82293fecb26eef97/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.680930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dafc9e9684d4d7f950fe2e58a32c968, user_id=da0516a18b35400d82293fecb26eef97, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.684152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.730044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 976/1955] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:12 2022] PUT /identity/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968/users/da0516a18b35400d82293fecb26eef97/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:12.731600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.731874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.732334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.760505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] MFA Rules not processed for user `da0516a18b35400d82293fecb26eef97`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:12.761716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:12.836906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 980/1956] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:12.849171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:12.904099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e15f-ddd3-4ef2-9d15-70c747623f21 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:12.908406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:12.909116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:12.909398 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:12.909731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:12.921395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:12.922882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6539b27-d4ca-4949-a0e2-dac4f47579e9 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:12.933115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 977/1957] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:12.959680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:13.024878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19b08-51dd-45df-a778-185f42fd55ae None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:13.030894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:13.031783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.032082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.032350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] PATH_INFO: `/v3/users/aae8d049fdee4c4cbb7ea54557e8017e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.033612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae8d049fdee4c4cbb7ea54557e8017e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:13.035656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:13.085037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae8d049fdee4c4cbb7ea54557e8017e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.093421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae8d049fdee4c4cbb7ea54557e8017e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.094065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae8d049fdee4c4cbb7ea54557e8017e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.100809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae8d049fdee4c4cbb7ea54557e8017e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.119419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae8d049fdee4c4cbb7ea54557e8017e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.128515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 981/1958] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:12 2022] DELETE /identity/v3/users/aae8d049fdee4c4cbb7ea54557e8017e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:13.134380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.134752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.134962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.153900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:13.155116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:13.216814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 978/1959] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:13.226897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:13.228607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:13.295315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5a85-d3ca-4487-a84c-87895349c738 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:13.299184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:13.299836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.300110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.300384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.310504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:13.312041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69253fac-09c6-4e2f-b9a7-2bf1b7501672 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:13.322694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 982/1960] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:13.742736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:13.744173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:13.761123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc5ac-3c64-41ad-9475-7f778299fa9b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:13.770365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:13.771451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.771724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.772001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] PATH_INFO: `/v3/projects/521b58e60a6b4598bd657ef78e2e3d64` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.774095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521b58e60a6b4598bd657ef78e2e3d64)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:13.775951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:13.841736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521b58e60a6b4598bd657ef78e2e3d64', 'request_id': 'req-72bac1e3-8a96-4967-8f35-f450655e01d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.847333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521b58e60a6b4598bd657ef78e2e3d64', 'request_id': 'req-72bac1e3-8a96-4967-8f35-f450655e01d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.872480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521b58e60a6b4598bd657ef78e2e3d64', 'request_id': 'req-72bac1e3-8a96-4967-8f35-f450655e01d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.873575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7886-4d06-4f4c-9175-59fbd872618c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.873888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7886-4d06-4f4c-9175-59fbd872618c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.874148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7886-4d06-4f4c-9175-59fbd872618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.891264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] The token cache is being invalidate because project 521b58e60a6b4598bd657ef78e2e3d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:13.891560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.892235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a02d7886-4d06-4f4c-9175-59fbd872618c None None] MFA Rules not processed for user `5adf0f1d005d4a1eb0136d4593b094b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:13.892953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:13.893628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a02d7886-4d06-4f4c-9175-59fbd872618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:13.900902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 979/1961] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:13 2022] DELETE /identity/v3/projects/521b58e60a6b4598bd657ef78e2e3d64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:13.902001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:13.903549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:13.986109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bac1e3-8a96-4967-8f35-f450655e01d2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:13.988150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 983/1962] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:13.989676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.990129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:13.990407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:13.998120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:13.999333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:13.999683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.000021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] PATH_INFO: `/v3/users/da0516a18b35400d82293fecb26eef97` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.001365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0516a18b35400d82293fecb26eef97)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:14.003878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:14.015774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] MFA Rules not processed for user `30c4ac1332b64a648d7214918f757f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:14.017204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:14.071330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0516a18b35400d82293fecb26eef97'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.098987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 984/1963] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:14.100397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0516a18b35400d82293fecb26eef97'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.116841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0516a18b35400d82293fecb26eef97'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.118425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0516a18b35400d82293fecb26eef97'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.130005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-064ecf2c-4657-4497-9b07-c9d1cdbf8d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0516a18b35400d82293fecb26eef97'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.140003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 980/1964] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:13 2022] DELETE /identity/v3/users/da0516a18b35400d82293fecb26eef97 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:14.469099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:14.482694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee50b8-9b6f-452e-8d37-c9b6c1437319 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:14.547751 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:14.548936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.549127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.549459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] PATH_INFO: `/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.551041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dafc9e9684d4d7f950fe2e58a32c968)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:14.553114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:14.601102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dafc9e9684d4d7f950fe2e58a32c968', 'request_id': 'req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.608226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dafc9e9684d4d7f950fe2e58a32c968', 'request_id': 'req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.616814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dafc9e9684d4d7f950fe2e58a32c968', 'request_id': 'req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.630307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] The token cache is being invalidate because project 7dafc9e9684d4d7f950fe2e58a32c968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:14.630602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.631369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c62253d5-b18e-4c4a-8caf-98ddb3cc3935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:14.633355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 985/1965] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:14 2022] DELETE /identity/v3/projects/7dafc9e9684d4d7f950fe2e58a32c968 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:14.638393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.638782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.639055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.658729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:14.659930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:14.725278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 981/1966] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:14.733179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.733538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.733827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.752869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:14.754085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:14.763170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 986/1967] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:14.767510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:14.778105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b7ed-786d-459b-9a2c-afe31ec7e1e3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:14.783612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:14.784363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.784540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.784793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.785680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:14.786018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:14.787703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:14.803951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 982/1968] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:14.805100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:14.821132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612ce6-99aa-4fa2-beff-fe81c272cc6d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:14.827443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:14.828465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.829041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.829611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.830764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:14.833528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:14.880395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:14.886749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 987/1969] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:14.893493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edde2-712d-4ee2-9e77-602fce1bcafb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:14.992693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:14.993963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:14.994344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:14.994748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:14.995658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:14.998185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.042627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.044590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 983/1970] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:14 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:15.057240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1146ee-7e5e-4334-9c38-0bb54bad8a58 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.063954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.065104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.065104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.065356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.066105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.068288 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.082108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 988/1971] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:15.085778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.096626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f2a4-8c39-420c-98cb-c36724582e94 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.115582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.116378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.116665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.116950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.117796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.120480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516bc87-db8c-4759-90ae-bf9a383a40a9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.134375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 984/1972] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:15.135592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.146997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad66d-68b3-4e1b-8b7f-c0ad3a891775 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.153113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.154373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.154852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.155263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] PATH_INFO: `/v3/projects/98df9632d3644d5382293598bb463db5/users/166d8237063e46cea0155cf061cf19fc/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.175216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98df9632d3644d5382293598bb463db5, user_id=166d8237063e46cea0155cf061cf19fc, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.180304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.200953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 989/1973] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:15 2022] PUT /identity/v3/projects/98df9632d3644d5382293598bb463db5/users/166d8237063e46cea0155cf061cf19fc/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:15.211734 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.212428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.212885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.246089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] MFA Rules not processed for user `166d8237063e46cea0155cf061cf19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:15.247929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:15.349745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 985/1974] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:15.354812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.433786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dff821-a22e-48f4-bd2d-cd3b856df763 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.444342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.445247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.445717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.446057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.446855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.448872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.475768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 990/1975] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:15 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:15.479732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.490419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f8c0a-3832-4cd4-ac69-cca8439bc1ab None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.568468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.569263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.569544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.569812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.570551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.572519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.595947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 986/1976] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:15 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:15.601502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.619887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ea14-330e-4b48-93d9-79b879ca8b35 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.628904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.629955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.630412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.630876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.632144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.635832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.654710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 991/1977] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:15.656967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.667021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bb00-c869-4697-9e8f-e525c77d90b6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.672754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.673584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.673859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.674128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] PATH_INFO: `/v3/projects/8f53ae435fb142fb9d451c24456bb871/users/922a85367bc14cbe977a71e278fdb466/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.690473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f53ae435fb142fb9d451c24456bb871, user_id=922a85367bc14cbe977a71e278fdb466, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.693214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.717583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 987/1978] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:15 2022] PUT /identity/v3/projects/8f53ae435fb142fb9d451c24456bb871/users/922a85367bc14cbe977a71e278fdb466/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:15.722600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.733778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39932b-7dc0-4d57-bb3d-cad9f8bd88d4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.797662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.798466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.798668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.798952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.799695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.801317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86613-50c7-4899-8a52-f5681b8c48c6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.813565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 992/1979] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:15.817977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.828708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8470e60-dab2-405b-a64c-e5004801ef2e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:15.833527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:15.834382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.834618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.834944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] PATH_INFO: `/v3/projects/8f53ae435fb142fb9d451c24456bb871/users/922a85367bc14cbe977a71e278fdb466/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.837091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f53ae435fb142fb9d451c24456bb871, user_id=922a85367bc14cbe977a71e278fdb466, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:15.839779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:15.850685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 988/1980] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:15 2022] PUT /identity/v3/projects/8f53ae435fb142fb9d451c24456bb871/users/922a85367bc14cbe977a71e278fdb466/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:15.862473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:15.862789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:15.863206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:15.892977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] MFA Rules not processed for user `922a85367bc14cbe977a71e278fdb466`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:15.894166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:15.981355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 993/1981] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:15.991627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:15.993356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:16.052803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e379-13c0-4a1b-8d0d-ed482ee37dc6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:16.056652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:16.057378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.057694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.057984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.070328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:16.073439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da29d-326f-40ac-925f-159eee5688c3 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:16.093935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 989/1982] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:16.167356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:16.233202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6be1-ea7d-476d-8496-6bc63b5326d7 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:16.237969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:16.238890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.241324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.241651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] PATH_INFO: `/v3/users/166d8237063e46cea0155cf061cf19fc` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.243059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166d8237063e46cea0155cf061cf19fc)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:16.244972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:16.306903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166d8237063e46cea0155cf061cf19fc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.319079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166d8237063e46cea0155cf061cf19fc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.319884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166d8237063e46cea0155cf061cf19fc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.327361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166d8237063e46cea0155cf061cf19fc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.339078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166d8237063e46cea0155cf061cf19fc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.344935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 994/1983] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:16 2022] DELETE /identity/v3/users/166d8237063e46cea0155cf061cf19fc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:16.349465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.349753 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.350035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.367822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:16.369093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:16.430458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 990/1984] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:16.442341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:16.444408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:16.510138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380b58-b653-41e1-a652-09f217250ca8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:16.514347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:16.515051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.515333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.515605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.526315 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:16.527807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:16.537714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 995/1985] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:16.803986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:16.805697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:16.825709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5461dc1-2942-4251-98ba-658bbc18fb7a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:16.833395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:16.834563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.834939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.835941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] PATH_INFO: `/v3/users/6d31da2c36364a9bace41359eb8efcd1` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.837500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d31da2c36364a9bace41359eb8efcd1)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:16.840505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:16.889708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d31da2c36364a9bace41359eb8efcd1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.896685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d31da2c36364a9bace41359eb8efcd1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.899285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:16.906908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:16.915133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d31da2c36364a9bace41359eb8efcd1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.916240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d31da2c36364a9bace41359eb8efcd1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.921697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e5807-6b57-4d18-ae6d-0bca75b1fcbb service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:16.927375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3e66fae7-ce21-4a85-92c1-4d09a455b6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d31da2c36364a9bace41359eb8efcd1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:16.928156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723fab-f114-491b-b533-242783697c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:16.929431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723fab-f114-491b-b533-242783697c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.929982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723fab-f114-491b-b533-242783697c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.930475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723fab-f114-491b-b533-242783697c27 admin admin] PATH_INFO: `/v3/projects/98df9632d3644d5382293598bb463db5` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.932060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723fab-f114-491b-b533-242783697c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98df9632d3644d5382293598bb463db5)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:16.934395 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723fab-f114-491b-b533-242783697c27 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:16.951079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 991/1986] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:16 2022] DELETE /identity/v3/users/6d31da2c36364a9bace41359eb8efcd1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:16.957323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:16.957611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:16.957893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:16.987651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:16.989640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:17.004873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98df9632d3644d5382293598bb463db5', 'request_id': 'req-92723fab-f114-491b-b533-242783697c27'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.011519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98df9632d3644d5382293598bb463db5', 'request_id': 'req-92723fab-f114-491b-b533-242783697c27'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.028911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98df9632d3644d5382293598bb463db5', 'request_id': 'req-92723fab-f114-491b-b533-242783697c27'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.039545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] The token cache is being invalidate because project 98df9632d3644d5382293598bb463db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:17.040394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.040766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.045629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 996/1987] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:16 2022] DELETE /identity/v3/projects/98df9632d3644d5382293598bb463db5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:17.046624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:17.048318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:17.080089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 992/1988] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:17.090466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:17.092199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:17.138999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723fab-f114-491b-b533-242783697c27 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:17.144388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:17.145789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:17.146331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:17.146621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] PATH_INFO: `/v3/users/922a85367bc14cbe977a71e278fdb466` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:17.147898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=922a85367bc14cbe977a71e278fdb466)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:17.150682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:17.155082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d98e-d3e3-4cf8-abe4-313f3ff5bb4b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:17.159545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:17.161017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:17.161487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:17.161926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:17.173676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:17.175546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:17.188675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 993/1989] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:17.243784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922a85367bc14cbe977a71e278fdb466'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.255112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922a85367bc14cbe977a71e278fdb466'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.255832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922a85367bc14cbe977a71e278fdb466'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.266977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922a85367bc14cbe977a71e278fdb466'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.283084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922a85367bc14cbe977a71e278fdb466'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.292155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 997/1990] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:17 2022] DELETE /identity/v3/users/922a85367bc14cbe977a71e278fdb466 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:17.709506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:17.711935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:17.734412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114aa4-5a36-43b8-9081-b55a2c5e2662 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:17.801244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:17.802130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:17.802974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:17.803264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] PATH_INFO: `/v3/projects/fbe911535191450099be7f5b922d951d` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:17.804850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe911535191450099be7f5b922d951d)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:17.806949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:17.859341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe911535191450099be7f5b922d951d', 'request_id': 'req-4647e3c4-af33-4a29-a81a-9228bf3656d7'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.868018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe911535191450099be7f5b922d951d', 'request_id': 'req-4647e3c4-af33-4a29-a81a-9228bf3656d7'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.882366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe911535191450099be7f5b922d951d', 'request_id': 'req-4647e3c4-af33-4a29-a81a-9228bf3656d7'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.895752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] The token cache is being invalidate because project fbe911535191450099be7f5b922d951d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:17.896148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.896911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:17.899173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 994/1991] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:17 2022] DELETE /identity/v3/projects/fbe911535191450099be7f5b922d951d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:17.903422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:17.904970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:17.918887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583d03-e953-4b2f-a560-d07f2c445a9c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:17.986545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:17.987619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:17.988090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:17.988376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] PATH_INFO: `/v3/users/f6a262c0fac64b869220194a4eda2098` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:17.989685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a262c0fac64b869220194a4eda2098)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:17.992389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.052626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.054353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:18.078343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647e3c4-af33-4a29-a81a-9228bf3656d7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.081570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a262c0fac64b869220194a4eda2098'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.088405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.090106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.090395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.090687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] PATH_INFO: `/v3/projects/8f53ae435fb142fb9d451c24456bb871` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.096868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f53ae435fb142fb9d451c24456bb871)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.098879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.116549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a262c0fac64b869220194a4eda2098'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.119978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a262c0fac64b869220194a4eda2098'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.130816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a262c0fac64b869220194a4eda2098'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.154587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-19fadb52-62a5-4b6a-b273-cc76ea2a08a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a262c0fac64b869220194a4eda2098'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.165499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 998/1992] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:17 2022] DELETE /identity/v3/users/f6a262c0fac64b869220194a4eda2098 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:18.165691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f53ae435fb142fb9d451c24456bb871', 'request_id': 'req-746d3acd-eff6-45ee-a861-f70c6936a5ba'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.171038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f53ae435fb142fb9d451c24456bb871', 'request_id': 'req-746d3acd-eff6-45ee-a861-f70c6936a5ba'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.180735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f53ae435fb142fb9d451c24456bb871', 'request_id': 'req-746d3acd-eff6-45ee-a861-f70c6936a5ba'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.194566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] The token cache is being invalidate because project 8f53ae435fb142fb9d451c24456bb871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:18.195217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.196304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-746d3acd-eff6-45ee-a861-f70c6936a5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.202456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 995/1993] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:18 2022] DELETE /identity/v3/projects/8f53ae435fb142fb9d451c24456bb871 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:18.212192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.213173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.213473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.243877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:18.246206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:18.333723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 999/1994] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:18.342211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.348135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.350099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.427706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:18.431055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:18.442021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 996/1995] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:18.450191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.480687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eaadb-f173-441e-b0cf-f29b05e90537 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.492493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.493868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.494383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.495428 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.496951 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:18.497484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.499468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.520190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1000/1996] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:18.522518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.533883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1e335-90a6-4290-b961-dd6fcf218d40 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.540599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.544086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.544970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.545355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.547541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.550689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.593026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 997/1997] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:18 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:18.594446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.605897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a166-72f7-439a-bbc4-8d3ca40a6388 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.688396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.689432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.689861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.690281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.691189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.693863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.720898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1001/1998] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:18 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:18.722929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.730046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.736007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:18.737939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f021-3689-4ad8-8312-c1e91f9b7a87 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.747823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.749858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.750152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.750429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.752065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.754417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.757348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab531-d8ee-470a-859e-7ef5c5d7c616 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.767775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.768768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.769278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.769644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] PATH_INFO: `/v3/projects/6f8c9a9fb9794b2aa49611e8f3176f10` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.772537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8c9a9fb9794b2aa49611e8f3176f10)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.778014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.826358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 998/1999] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:18.827563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.847404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccde168-512d-4b37-bd73-4704a326ae3e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.852726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.853743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.854203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.854616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.855565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.857974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.868742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8c9a9fb9794b2aa49611e8f3176f10', 'request_id': 'req-b5865b92-4844-440c-9ac4-21d6402c2f30'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.874624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8c9a9fb9794b2aa49611e8f3176f10', 'request_id': 'req-b5865b92-4844-440c-9ac4-21d6402c2f30'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.876244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 999/2000] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:18.877361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.885229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8c9a9fb9794b2aa49611e8f3176f10', 'request_id': 'req-b5865b92-4844-440c-9ac4-21d6402c2f30'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.887721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e709-750d-4ec8-8e30-7cd1ce98a24e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.899594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] The token cache is being invalidate because project 6f8c9a9fb9794b2aa49611e8f3176f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:18.899875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.900540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:18.905267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1002/2001] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:18 2022] DELETE /identity/v3/projects/6f8c9a9fb9794b2aa49611e8f3176f10 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:18.906124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:18.907719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:18.946534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.947932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.948420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.949467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] PATH_INFO: `/v3/projects/f5247182fd214ca9be339e038b2eb87f/users/6e069d556ae743a6a91b1343a568ead0/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.964866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5247182fd214ca9be339e038b2eb87f, user_id=6e069d556ae743a6a91b1343a568ead0, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.967744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a88a-51f2-4e40-8f73-88bb645b143a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.972937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865b92-4844-440c-9ac4-21d6402c2f30 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:18.980088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:18.981087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.981568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.981568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] PATH_INFO: `/v3/users/16a40d9dc90749199d563222142818bb` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:18.982782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a40d9dc90749199d563222142818bb)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:18.984809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:18.986877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1000/2002] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:18 2022] PUT /identity/v3/projects/f5247182fd214ca9be339e038b2eb87f/users/6e069d556ae743a6a91b1343a568ead0/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:18.995332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:18.995772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:18.997179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.038928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a40d9dc90749199d563222142818bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.039081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] MFA Rules not processed for user `6e069d556ae743a6a91b1343a568ead0`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:19.040413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:19.049731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a40d9dc90749199d563222142818bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.050903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a40d9dc90749199d563222142818bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.060894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a40d9dc90749199d563222142818bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.077026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a40d9dc90749199d563222142818bb'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.084825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1003/2003] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:18 2022] DELETE /identity/v3/users/16a40d9dc90749199d563222142818bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:19.132931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1001/2004] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:19.133266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.134530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:19.222488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557618c-faac-4784-97a8-8dcbe5ecf561 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.229186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.230078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.230465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.230873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.231714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.233755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.266699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1004/2005] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:19 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:19.268823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.357074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2b75-bb7e-4ea2-8638-1ba57430b5b4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.445965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.447129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.447403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.447671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.449368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.452324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.478290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1002/2006] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:19 2022] POST /identity/v3/users => generated 307 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:19.479498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.491809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56280dcc-ca9a-4b5f-b5a1-6533e2628dbe admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.500510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.501672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.501955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.502234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.503284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.504965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.519245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1005/2007] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:19.522086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.534453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2ae3-7907-4730-846c-6cc3ff3f60d7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.539969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.541347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.541458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.541718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] PATH_INFO: `/v3/projects/30d3c7ddea8b41e98481c51acda455f7/users/5563461b65bc40719ec23bd9f92156c3/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.561340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d3c7ddea8b41e98481c51acda455f7, user_id=5563461b65bc40719ec23bd9f92156c3, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.565616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.581316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1003/2008] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:19 2022] PUT /identity/v3/projects/30d3c7ddea8b41e98481c51acda455f7/users/5563461b65bc40719ec23bd9f92156c3/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:19.585582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.599280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd96e01-89a8-412d-9bd5-dd759738defb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.645406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.649983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:19.768382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.769233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.769581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.769925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.770842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.772616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.809830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1006/2009] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:19.815124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:19.850568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a79ad-93cf-42a0-9a0a-ca9240c871fe admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.866843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.869658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.870238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.870678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] PATH_INFO: `/v3/projects/30d3c7ddea8b41e98481c51acda455f7/users/5563461b65bc40719ec23bd9f92156c3/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.874325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55e4f-204b-4b70-9115-e69586c6f59d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:19.874984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d3c7ddea8b41e98481c51acda455f7, user_id=5563461b65bc40719ec23bd9f92156c3, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.878539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348ad6-4ebb-46b4-8a2b-367c38c8321b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.887125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:19.888299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.888431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.888644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] PATH_INFO: `/v3/projects/87304169b9d84b8b9b2cb4de18abc38e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.890388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=87304169b9d84b8b9b2cb4de18abc38e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:19.893683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:19.899702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1007/2010] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:19 2022] PUT /identity/v3/projects/30d3c7ddea8b41e98481c51acda455f7/users/5563461b65bc40719ec23bd9f92156c3/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:19.912161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:19.913043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:19.913324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:19.944754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] MFA Rules not processed for user `5563461b65bc40719ec23bd9f92156c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:19.946099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:19.972784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87304169b9d84b8b9b2cb4de18abc38e', 'request_id': 'req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:19.987923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87304169b9d84b8b9b2cb4de18abc38e', 'request_id': 'req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:20.006517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87304169b9d84b8b9b2cb4de18abc38e', 'request_id': 'req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:20.026251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] The token cache is being invalidate because project 87304169b9d84b8b9b2cb4de18abc38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:20.026542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:20.027303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4cd3a689-9cca-4d4b-85e9-07b6efcd1dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:20.034555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1004/2011] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:19 2022] DELETE /identity/v3/projects/87304169b9d84b8b9b2cb4de18abc38e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:20.036741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd6b65-abfc-4fe0-972c-28a359a59a9b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.037074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd6b65-abfc-4fe0-972c-28a359a59a9b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.037314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd6b65-abfc-4fe0-972c-28a359a59a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.063834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1008/2012] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:20.073667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.076080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a5cd6b65-abfc-4fe0-972c-28a359a59a9b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:20.077139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:20.080536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a5cd6b65-abfc-4fe0-972c-28a359a59a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:20.185711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceb498-017b-4ad3-865c-d5846f737c90 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.189719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.191275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.191892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.192337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.203746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.205844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.238004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1005/2013] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:20.238517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1009/2014] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:20.245588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.245870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.246144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.283738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:20.285067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:20.294447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1006/2015] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:20.298400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.323039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253f30-002f-4d65-a064-b4e052682395 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.331297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.332050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.332331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.332576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.332738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.333443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:20.333749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.335921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.358580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1010/2016] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:20.359015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd5f9b-9fd4-4efc-bc0e-dacd62b889a4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.360113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.364533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.367587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.367972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.369505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.376268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:20.386182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8fc0c-a999-45fb-8181-a450b64a9443 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.399646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.400548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.401685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.403267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.405861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.408644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.443912 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1011/2017] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:20 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:20.448747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.470390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.471806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.481768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1007/2018] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:20.544859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8b5-d430-45cf-8747-58aedf25c568 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.551321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.552067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.552893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.553276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.554210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.556958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.614442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1012/2019] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:20 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:20.618692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.636956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f2be4-69f4-4710-bd0f-76c90aaa63b3 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.644454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.645469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.646375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.646978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.648509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.650829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.666559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1008/2020] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:20.671907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.698029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1dab-a275-41c2-a892-6f3a77e2f33d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.726389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.730061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.730487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.730743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.731586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.733231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ace1-d0b9-4627-be6a-25be772013a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.770100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:20.772827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1013/2021] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:20.792113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13278b7f-30ec-430f-a5a1-d68ce19d9db4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:20.798119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:20.799080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.799361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.800201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] PATH_INFO: `/v3/projects/d5004479d4bd4f41b2a3b0abeac8797c/users/9a7d989026d044808ba64326eb482dca/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.817092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5004479d4bd4f41b2a3b0abeac8797c, user_id=9a7d989026d044808ba64326eb482dca, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:20.820432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:20.839580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1009/2022] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:20 2022] PUT /identity/v3/projects/d5004479d4bd4f41b2a3b0abeac8797c/users/9a7d989026d044808ba64326eb482dca/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:20.850299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421848-51df-4ecb-8db4-4c417c6c8a7f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:20.850624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421848-51df-4ecb-8db4-4c417c6c8a7f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:20.850941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421848-51df-4ecb-8db4-4c417c6c8a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:20.930911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fe421848-51df-4ecb-8db4-4c417c6c8a7f None None] MFA Rules not processed for user `9a7d989026d044808ba64326eb482dca`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:20.931872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fe421848-51df-4ecb-8db4-4c417c6c8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:21.017107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1014/2023] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:21.028911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:21.030890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:21.086929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf11-644e-4545-a42e-456b3147bf4a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:21.090891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:21.091532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:21.091808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:21.092076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:21.100422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:21.101878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:21.110691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1010/2024] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:23.279283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e36d-41a9-4131-875b-247c66dd90c8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:23.279852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e36d-41a9-4131-875b-247c66dd90c8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:23.279852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e36d-41a9-4131-875b-247c66dd90c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:23.297832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-0651e36d-41a9-4131-875b-247c66dd90c8 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:23.299243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0651e36d-41a9-4131-875b-247c66dd90c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:23.362442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1015/2025] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:23.406932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:23.408462 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:23.482219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d95117-c1cf-4915-ab62-f455c45fe2e0 service glance] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:23.487930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:23.488558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:23.488832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:23.489099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:23.501395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:23.503275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:23.512219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1011/2026] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:38:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:24.100346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526bc6-908d-49ee-a294-134744d6120b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:24.100656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526bc6-908d-49ee-a294-134744d6120b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:24.100930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526bc6-908d-49ee-a294-134744d6120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:24.120800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-be526bc6-908d-49ee-a294-134744d6120b None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:24.122362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-be526bc6-908d-49ee-a294-134744d6120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:24.130336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1016/2027] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:24.142983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:24.155771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe968c8-cfe9-4d73-9284-0538856a5af0 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:24.161107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:24.161760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:24.162038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:24.162307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:24.170959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:24.172773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:24.201182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1012/2028] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:38:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:24.471145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:24.471651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:24.471733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:24.491696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:24.493497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:24.507403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1017/2029] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:24.523862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:24.543601 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd2c51-2cb6-4f4d-8b11-37d8244572b8 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:24.550740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:24.551704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:24.552048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:24.552422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:24.564283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:24.566199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c234d-7756-4fbb-998e-39bf3b30f907 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:24.576723 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1013/2030] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:38:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:24.927082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:24.927292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:25.027900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f7eb-d6cf-48c5-87b6-e5a610c59ef8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:25.042969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:25.044026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.044200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.044312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.044583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] PATH_INFO: `/v3/users/6e069d556ae743a6a91b1343a568ead0` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.044707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.044996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.045969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e069d556ae743a6a91b1343a568ead0)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:25.048417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:25.066063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:25.067473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:25.079879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1014/2031] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:38:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:25.096289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:25.112497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44880d56-3b81-4a77-b580-3c04b1a590d0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:25.117499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e069d556ae743a6a91b1343a568ead0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.119277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:25.119949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.120222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.120556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.127190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e069d556ae743a6a91b1343a568ead0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.127937 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e069d556ae743a6a91b1343a568ead0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.130822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:25.132516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599b0b-f927-4701-8f78-5af8c4485366 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:25.135983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e069d556ae743a6a91b1343a568ead0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.141520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1015/2032] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:38:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:25.151274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e069d556ae743a6a91b1343a568ead0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.159093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1018/2033] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:24 2022] DELETE /identity/v3/users/6e069d556ae743a6a91b1343a568ead0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:25.164604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.164988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.165475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.184738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:25.186071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:25.250142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1016/2034] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:25.256033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:25.257553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:25.327752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f2763-af9e-46e4-933e-b55d3b25597b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:25.331510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:25.332163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.332440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.336577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.344137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:25.346796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:25.356703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1019/2035] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:25.701442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:25.703679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:25.729048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c24e5-335f-4f91-b63f-6e6ee84ed3a3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:25.738051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:25.739835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.740119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.740458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] PATH_INFO: `/v3/projects/f5247182fd214ca9be339e038b2eb87f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.741757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5247182fd214ca9be339e038b2eb87f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:25.743793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:25.805248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5247182fd214ca9be339e038b2eb87f', 'request_id': 'req-471ac3f8-3c2f-48c3-b760-c04dcc734035'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.810486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5247182fd214ca9be339e038b2eb87f', 'request_id': 'req-471ac3f8-3c2f-48c3-b760-c04dcc734035'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.818676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5247182fd214ca9be339e038b2eb87f', 'request_id': 'req-471ac3f8-3c2f-48c3-b760-c04dcc734035'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.832269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] The token cache is being invalidate because project f5247182fd214ca9be339e038b2eb87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:25.832559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.833200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.837566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1017/2036] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:25 2022] DELETE /identity/v3/projects/f5247182fd214ca9be339e038b2eb87f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:25.839038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:25.851174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df44488-51f9-4896-b4b4-17d1ca525f5b service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:25.922032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:25.922980 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:25.923273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:25.923545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] PATH_INFO: `/v3/users/5563461b65bc40719ec23bd9f92156c3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:25.924855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5563461b65bc40719ec23bd9f92156c3)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:25.926945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:25.983883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5563461b65bc40719ec23bd9f92156c3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.994850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5563461b65bc40719ec23bd9f92156c3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:25.996722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5563461b65bc40719ec23bd9f92156c3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.005996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5563461b65bc40719ec23bd9f92156c3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.024060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-45bd9054-0e1a-4aeb-9db3-4e8740c26ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5563461b65bc40719ec23bd9f92156c3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.034290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1020/2037] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:25 2022] DELETE /identity/v3/users/5563461b65bc40719ec23bd9f92156c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:26.423575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:26.425017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:26.450190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ac3f8-3c2f-48c3-b760-c04dcc734035 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:26.507199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:26.508189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.508473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.508747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] PATH_INFO: `/v3/projects/30d3c7ddea8b41e98481c51acda455f7` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.510017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d3c7ddea8b41e98481c51acda455f7)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:26.512090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:26.562739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d3c7ddea8b41e98481c51acda455f7', 'request_id': 'req-c54667cd-61fa-43ec-ae83-991e8e7d9589'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.569375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d3c7ddea8b41e98481c51acda455f7', 'request_id': 'req-c54667cd-61fa-43ec-ae83-991e8e7d9589'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.578162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d3c7ddea8b41e98481c51acda455f7', 'request_id': 'req-c54667cd-61fa-43ec-ae83-991e8e7d9589'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.589889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] The token cache is being invalidate because project 30d3c7ddea8b41e98481c51acda455f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:26.590173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.590952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c54667cd-61fa-43ec-ae83-991e8e7d9589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:26.592587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1018/2038] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:26 2022] DELETE /identity/v3/projects/30d3c7ddea8b41e98481c51acda455f7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:26.597748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.598025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.598302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.616684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:26.617958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:26.681609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1021/2039] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:26.689883 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.690171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.690444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.710751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:26.712002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:26.721127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1019/2040] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:26.725599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:26.736486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023fdca-1285-42b1-a182-81fa80c2b8cf None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:26.741777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:26.742507 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.742820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.743099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.743893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:26.744535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:26.745785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:26.759193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1022/2041] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:26.763973 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:26.773399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa8d7-e3e4-4570-885d-6a2e6d89dade None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:26.778097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:26.778866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.779145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.779422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.780132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:26.782145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:26.818829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1020/2042] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:26.819983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:26.832261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a961f-19b0-40dd-b434-d569e4b57abd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:26.900055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:26.901379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.901807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.902242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.903914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:26.906474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:26.956479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1023/2043] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:26 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:26.960744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:26.973692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819219cb-a67e-41e2-b580-1ce0c2213d5e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:26.979497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:26.980173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:26.980429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:26.980699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:26.981441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:26.983377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:26.999590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1021/2044] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:26.999690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.009873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a6cee-d555-43c4-b839-399716cee415 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.014926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.015644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.015926 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.016199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.017195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.019095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a9ca2-c218-4e0e-9c09-f579f7e6bcbb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.030076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1024/2045] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:27.034849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.044936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92bfc1-4912-4a91-b6d6-caf0ea3e7589 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.049486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.050380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.050682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.050941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] PATH_INFO: `/v3/projects/537c8697580b4be8980ce81c8d77b15a/users/f85b60b1c5234c169907d55accab8a2b/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.068142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=537c8697580b4be8980ce81c8d77b15a, user_id=f85b60b1c5234c169907d55accab8a2b, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.070914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.085159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1022/2046] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:27 2022] PUT /identity/v3/projects/537c8697580b4be8980ce81c8d77b15a/users/f85b60b1c5234c169907d55accab8a2b/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:27.101220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.101556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.101859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.133769 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] MFA Rules not processed for user `f85b60b1c5234c169907d55accab8a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:27.135003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.201004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1025/2047] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:27.205630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.283652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3171e6-77e4-4f35-b63a-01dbb4dcc8bb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.289052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.289726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.290100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.290375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.291125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.293039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.319840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1023/2048] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:27 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:27.324082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.335261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e3ade-f9e8-4e82-84a6-da53ce6ee3f1 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.394587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.395292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.395572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.395843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.396561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.398564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.422641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1026/2049] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:27 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:27.424286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.438576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1d9c3-37e0-423c-a148-35afb215a32a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.445493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.446282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.446628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.446939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.447696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.449369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.461077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1024/2050] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:27.462229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.464335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.465088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.476833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3fa9-56e4-476a-82d7-b57c34b608b5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.477031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c887a-2797-4b90-a89d-f9c4fb020417 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.481587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.482645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.482797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.482964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.483211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] PATH_INFO: `/v3/projects/1e72aa87ba8848cf953b275aae707803/users/8660d53ab8d143f39f71b49d102ef8c8/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.483697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.483985 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.484262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] PATH_INFO: `/v3/users/53ecdf0e91ea4289bbc145d4c0970795` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.485606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ecdf0e91ea4289bbc145d4c0970795)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.487520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.499024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e72aa87ba8848cf953b275aae707803, user_id=8660d53ab8d143f39f71b49d102ef8c8, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.501685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.517371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1025/2051] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:27 2022] PUT /identity/v3/projects/1e72aa87ba8848cf953b275aae707803/users/8660d53ab8d143f39f71b49d102ef8c8/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:27.521623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.541934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ecdf0e91ea4289bbc145d4c0970795'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:27.549295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ecdf0e91ea4289bbc145d4c0970795'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:27.551085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ecdf0e91ea4289bbc145d4c0970795'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:27.559634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ecdf0e91ea4289bbc145d4c0970795'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:27.572992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7a68f181-b465-4149-8781-44b600b1ed63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ecdf0e91ea4289bbc145d4c0970795'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:27.579568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1027/2052] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:27 2022] DELETE /identity/v3/users/53ecdf0e91ea4289bbc145d4c0970795 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:27.584161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.584453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.584810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.597253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896deaa-7592-4dde-94ea-c0fbbad7f59a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.602295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:27.603641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.673182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1028/2053] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:27.673695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.674437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.674744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.675044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.675803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.677483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.690629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.692009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.694536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1026/2054] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:27.699960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.701663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.714691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999db1-ed5d-43b3-9b13-9a439eb14176 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.719683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.720594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.720977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.721262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] PATH_INFO: `/v3/projects/1e72aa87ba8848cf953b275aae707803/users/8660d53ab8d143f39f71b49d102ef8c8/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.723710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e72aa87ba8848cf953b275aae707803, user_id=8660d53ab8d143f39f71b49d102ef8c8, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.726791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b9d17-90b1-4feb-bfb6-6e06dd296f16 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.738386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1027/2055] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:27 2022] PUT /identity/v3/projects/1e72aa87ba8848cf953b275aae707803/users/8660d53ab8d143f39f71b49d102ef8c8/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:27.751598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.751998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.752330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.761743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eee6a-ef39-43a6-aa9d-60513d41d609 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.784668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] MFA Rules not processed for user `8660d53ab8d143f39f71b49d102ef8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:27.785877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.814379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.815076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.815357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.815630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.860808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1028/2056] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:27.872138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:27.873705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:27.886055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.887871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:27.899385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1029/2057] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:27.946989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048975d-7587-40f1-b990-1e40d6a5df33 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:27.951550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:27.952209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:27.952851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:27.953417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:27.987893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:27.989583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.008225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1029/2058] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:28.184672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.187505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.202387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.213325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983053b1-5290-46de-a13c-df4a7aac1147 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.218756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.219971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.220910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.221605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] PATH_INFO: `/v3/projects/40bfef4d74674be08aca4f965b2c2166` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.223967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bfef4d74674be08aca4f965b2c2166)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.226464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d6dbe-4082-46d0-8cd1-677db9a5ffb3 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.226831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.243580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.245124 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.245486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.245854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] PATH_INFO: `/v3/users/f85b60b1c5234c169907d55accab8a2b` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.249113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85b60b1c5234c169907d55accab8a2b)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.253950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.316352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bfef4d74674be08aca4f965b2c2166', 'request_id': 'req-14650ec1-53f7-40a3-9f22-55617ec6de6c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.327373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bfef4d74674be08aca4f965b2c2166', 'request_id': 'req-14650ec1-53f7-40a3-9f22-55617ec6de6c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.339300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85b60b1c5234c169907d55accab8a2b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.339806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bfef4d74674be08aca4f965b2c2166', 'request_id': 'req-14650ec1-53f7-40a3-9f22-55617ec6de6c'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.349420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85b60b1c5234c169907d55accab8a2b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.359278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] The token cache is being invalidate because project 40bfef4d74674be08aca4f965b2c2166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:28.359906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.361145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-14650ec1-53f7-40a3-9f22-55617ec6de6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.367065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85b60b1c5234c169907d55accab8a2b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.367793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1030/2059] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:28 2022] DELETE /identity/v3/projects/40bfef4d74674be08aca4f965b2c2166 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:28.369321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a77b-a048-4038-953d-94041f02895d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.369637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a77b-a048-4038-953d-94041f02895d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.370036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a77b-a048-4038-953d-94041f02895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.371047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85b60b1c5234c169907d55accab8a2b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.382834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-059b52a9-b821-4513-96e1-c272fa2a4c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85b60b1c5234c169907d55accab8a2b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:28.391780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1030/2060] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:28 2022] DELETE /identity/v3/users/f85b60b1c5234c169907d55accab8a2b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:28.396073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c353a77b-a048-4038-953d-94041f02895d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:28.396838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c353a77b-a048-4038-953d-94041f02895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.400328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.401886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.402391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.427077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:28.429248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.490150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1031/2061] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:28.499859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.500410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.500974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.530541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1031/2062] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:28.539293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:28.540639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.550065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.555514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.557604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1032/2063] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:28.561933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.580434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60511bf-3827-45e9-a93c-f5c35853b41b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.587019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.587756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.588041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.588686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.589067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:28.589378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.591035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.604463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1033/2064] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:38:28.609141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.619933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c0f7b-ed78-4b9f-bc90-399c7109011e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.625415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.626194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.627248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.627248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.627641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.631583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.653134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb006-53f8-4c2f-9f1d-4b7130367c79 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.658387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.659237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.659567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.659824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.670518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1034/2065] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:28.675102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.678240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.679997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.695752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1032/2066] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:28.753713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c2fbb-5129-4e50-a4b9-db713394c501 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.762344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.763114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.763398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.763689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.764398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.766462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.791065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1035/2067] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:28.792434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.802247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05f9d-b8eb-4533-843b-034d4937d23b service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.807354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.808031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.808309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.808727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.809477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.811162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.826927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1033/2068] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:28.828342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.841871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6160fc-7088-43a0-bb30-aa4a0727b6b8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.849167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.849913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.850201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.852218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.852218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.852976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aacf1-1acc-4b18-8181-6a31ed754173 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.864136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1036/2069] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:28.868851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.880370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259402e-2e78-419a-9820-fe13efb12498 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:28.886180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:28.887190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.887468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.887739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] PATH_INFO: `/v3/projects/9861d9e039084b9b9b24721464eea6e6/users/1521bf93314c437798ef374963def38e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.903872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9861d9e039084b9b9b24721464eea6e6, user_id=1521bf93314c437798ef374963def38e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:28.906612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:28.924267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1034/2070] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:28 2022] PUT /identity/v3/projects/9861d9e039084b9b9b24721464eea6e6/users/1521bf93314c437798ef374963def38e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:28.929878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:28.930174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:28.930456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:28.941084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:28.946939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:28.954716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:28.956364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.027795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1037/2071] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:29.029732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a6ff0-6943-4822-b210-c71ceff6c98c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.035027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.035941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.036216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.036667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] PATH_INFO: `/v3/users/003425f2d3474769b4f996f680088f94` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.037945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003425f2d3474769b4f996f680088f94)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.040322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.040533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:29.041943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.109967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003425f2d3474769b4f996f680088f94'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.119434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003425f2d3474769b4f996f680088f94'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.131896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d3196-6cb7-44dd-8b59-293422867798 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.134368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003425f2d3474769b4f996f680088f94'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.135145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003425f2d3474769b4f996f680088f94'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.136023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.137904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.138422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.138754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.145223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003425f2d3474769b4f996f680088f94'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.150210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.151753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.153392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1035/2072] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:28 2022] DELETE /identity/v3/users/003425f2d3474769b4f996f680088f94 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:29.170748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1038/2073] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:29.399363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:29.401617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.463845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:29.475766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901ba3-5671-46b5-b7b2-0ce5d536281d service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.522299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981dfbc-17dd-4b44-b3e7-9d1ec83f9355 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.533991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.535208 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.540410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.540635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] PATH_INFO: `/v3/projects/537c8697580b4be8980ce81c8d77b15a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.542461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537c8697580b4be8980ce81c8d77b15a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.544797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.560280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.561206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.561551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.561956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] PATH_INFO: `/v3/projects/b1ad4b9bfe7941d3baa9c36cf551a874` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.563501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ad4b9bfe7941d3baa9c36cf551a874)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.565779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.605828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537c8697580b4be8980ce81c8d77b15a', 'request_id': 'req-000bede0-f929-4098-acb3-fa41f79a0965'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.611714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537c8697580b4be8980ce81c8d77b15a', 'request_id': 'req-000bede0-f929-4098-acb3-fa41f79a0965'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.622772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537c8697580b4be8980ce81c8d77b15a', 'request_id': 'req-000bede0-f929-4098-acb3-fa41f79a0965'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.651953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'request_id': 'req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.655475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] The token cache is being invalidate because project 537c8697580b4be8980ce81c8d77b15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:29.655795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.666260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.668120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1036/2074] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:29 2022] DELETE /identity/v3/projects/537c8697580b4be8980ce81c8d77b15a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:29.673271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:29.674685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.675905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'request_id': 'req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.704143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'request_id': 'req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.722808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] The token cache is being invalidate because project b1ad4b9bfe7941d3baa9c36cf551a874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:29.722808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.723908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5b8f12c5-00d2-4376-9f7e-a280251b8e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:29.726220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1039/2075] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:29 2022] DELETE /identity/v3/projects/b1ad4b9bfe7941d3baa9c36cf551a874 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:29.731573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640ce6-c814-4f65-9891-b0cef9337349 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.732179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640ce6-c814-4f65-9891-b0cef9337349 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.732692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640ce6-c814-4f65-9891-b0cef9337349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.756319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5a640ce6-c814-4f65-9891-b0cef9337349 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:29.757803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5a640ce6-c814-4f65-9891-b0cef9337349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.832742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bede0-f929-4098-acb3-fa41f79a0965 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.854698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1040/2076] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:29.860560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.861214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.862682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.910722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:29.911941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:29.939369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1041/2077] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:29.940457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:29.941343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.942778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.943360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.943792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] PATH_INFO: `/v3/users/8660d53ab8d143f39f71b49d102ef8c8` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.948823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8660d53ab8d143f39f71b49d102ef8c8)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.951065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.952833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71daed9-5e71-454d-9a66-30c33897a8b8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:29.961950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:29.964538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:29.964949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:29.965294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:29.966766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:29.969037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:29.971803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:29.986092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1042/2078] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:29.990725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.001892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257bc47-9009-4f58-87a0-f6e8e9c5f5c6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.007167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.008798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.009140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.009485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.010460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.012451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.025100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8660d53ab8d143f39f71b49d102ef8c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.037625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8660d53ab8d143f39f71b49d102ef8c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.056721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8660d53ab8d143f39f71b49d102ef8c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.060409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8660d53ab8d143f39f71b49d102ef8c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.063370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1043/2079] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:29 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:30.067587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.075824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8660d53ab8d143f39f71b49d102ef8c8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.087662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1037/2080] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:29 2022] DELETE /identity/v3/users/8660d53ab8d143f39f71b49d102ef8c8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:30.170471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e577b-fff8-486d-bff0-86dcb7a49802 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.252714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.253469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.253753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.254027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.257803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.259855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.285726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1044/2081] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:30 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:30.292140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.293584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.306693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9b51-3b8b-485d-80c5-882680ad8aff admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.318554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.319460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.319864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.323513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.324222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.326525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.349354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.359811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1038/2082] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:30.364166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b723-c91b-4811-b598-74bc9025934a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.370987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.372064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.372339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.372623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.374070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.384024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a13c7b-735c-4488-b952-8156c5e03bd2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.405805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.406271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1045/2083] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:30.418501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffead3-66e2-4a3b-8dc1-57c01917b8b8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.424154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.425147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.425473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.425748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] PATH_INFO: `/v3/projects/114e0c095df64647bf339f0e8dcf8571/users/ddab0c5f110c41eba9629f8020db02fa/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.444269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=114e0c095df64647bf339f0e8dcf8571, user_id=ddab0c5f110c41eba9629f8020db02fa, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.447821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.468521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1039/2084] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:30 2022] PUT /identity/v3/projects/114e0c095df64647bf339f0e8dcf8571/users/ddab0c5f110c41eba9629f8020db02fa/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:30.474851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.475535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.475952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.502049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:30.503784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.513809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.516197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.609174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1046/2085] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:30.620607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.623902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.626446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eddb3e-417d-4724-8bba-cdd75e877d1a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.635129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.636172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.636527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.636894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] PATH_INFO: `/v3/projects/1e72aa87ba8848cf953b275aae707803` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.638266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e72aa87ba8848cf953b275aae707803)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.640559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.703060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1386555-e5e8-484c-ab77-4fd3cefd3c5d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.707566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e72aa87ba8848cf953b275aae707803', 'request_id': 'req-56306d70-4b35-4e24-9b25-31beca522765'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.714020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e72aa87ba8848cf953b275aae707803', 'request_id': 'req-56306d70-4b35-4e24-9b25-31beca522765'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.726924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e72aa87ba8848cf953b275aae707803', 'request_id': 'req-56306d70-4b35-4e24-9b25-31beca522765'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.750927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] The token cache is being invalidate because project 1e72aa87ba8848cf953b275aae707803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:30.751214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.753486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-56306d70-4b35-4e24-9b25-31beca522765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:30.756641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1040/2086] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:30 2022] DELETE /identity/v3/projects/1e72aa87ba8848cf953b275aae707803 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:30.761823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e458-45d3-4357-b448-96e6bd0c9f8d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.762447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e458-45d3-4357-b448-96e6bd0c9f8d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.762931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746e458-45d3-4357-b448-96e6bd0c9f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.785699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.786545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.786718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.787250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.789266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.791353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-5746e458-45d3-4357-b448-96e6bd0c9f8d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:30.793404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5746e458-45d3-4357-b448-96e6bd0c9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.868286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1041/2087] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:30.876443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.876961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.877203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.877728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.879589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.894893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1047/2088] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:30.907688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:30.909357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:30.923599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1042/2089] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:30.928692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:30.946431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d151f4-55fc-4174-acc9-9154b7ba2849 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:30.957489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:30.959494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:30.960052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:30.960371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:30.963055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:30.963379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:30.967195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:30.998450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1048/2090] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:30.999680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.013956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd931-0e52-46ef-9cd1-691582ec6d13 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.020216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.022019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.022502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.023171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.024147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.030709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.066445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1043/2091] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:30 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:31.070517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.080709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60029-5df2-4940-8776-1096637595a7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.173050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.173759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.174033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.174305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.176273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.186560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.235674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1049/2092] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:31 2022] POST /identity/v3/users => generated 305 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:31.236724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.252367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4a93b-8e80-4a1e-893c-a16636fb0abf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.264009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.265151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.266950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.271796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.273091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.279972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.292432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1044/2093] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:31.296879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.308787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1136e-b5f3-4484-b2aa-299501724847 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.316363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.317069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.317354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.317636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.318486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.320239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa0655-5721-4e04-b8c7-ff97c24d3c43 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.344087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1050/2094] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:31.348627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.359901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd24d-90e0-409e-8595-d94481c964f4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.364633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.365538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.365818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.366094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] PATH_INFO: `/v3/projects/0227cbd2e3f840b6a48c294445426f54/users/82f3adb182ec46c09501114e9b6daeed/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.392754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0227cbd2e3f840b6a48c294445426f54, user_id=82f3adb182ec46c09501114e9b6daeed, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.397051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.427346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1045/2095] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:31 2022] PUT /identity/v3/projects/0227cbd2e3f840b6a48c294445426f54/users/82f3adb182ec46c09501114e9b6daeed/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:31.438298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.438634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.438955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.480420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] MFA Rules not processed for user `82f3adb182ec46c09501114e9b6daeed`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:31.482456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:31.645531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1051/2096] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:31.646131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.761938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8b15-f75b-4f8e-bbe9-1df4413fd3b8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.767144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.768161 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.768730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.769182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.770166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.772275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.826287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1046/2097] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:31 2022] POST /identity/v3/projects => generated 407 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:31.832128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:31.853530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3f3b8-e074-4dd6-a84b-7558a291293c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:31.938846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:31.941495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:31.941782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:31.942250 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:31.943089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:31.945237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:31.970075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1052/2098] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:31 2022] POST /identity/v3/users => generated 310 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:31.975220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:32.015202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80d61d-da56-4954-826b-2341cd689240 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:32.036584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:32.037643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.037643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.039005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.040297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:32.050250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:32.076673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1047/2099] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:32.081249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:32.092141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdc63b-da11-4bd9-8ef1-624cdc04477b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:32.097561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:32.098515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.098907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.099252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] PATH_INFO: `/v3/projects/990427b3686547f6b46f74cba113e966/users/68b07ef60ec047acb9ed730beb74939f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.135382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990427b3686547f6b46f74cba113e966, user_id=68b07ef60ec047acb9ed730beb74939f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:32.138773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:32.170934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1053/2100] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:32 2022] PUT /identity/v3/projects/990427b3686547f6b46f74cba113e966/users/68b07ef60ec047acb9ed730beb74939f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:32.172052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:32.190158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199ecd-0534-48ff-97cb-d15ab35d1a22 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:32.291430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:32.292218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.292499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.292774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.296676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:32.299985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227c7f-512d-4c1f-b40e-4e0451aa538c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:32.333455 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1048/2101] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:32.338400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:32.351416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b97ab-e447-4b1a-b122-4092d4a0d3a3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:32.358062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:32.359036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.359317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.359591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] PATH_INFO: `/v3/projects/990427b3686547f6b46f74cba113e966/users/68b07ef60ec047acb9ed730beb74939f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.361776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990427b3686547f6b46f74cba113e966, user_id=68b07ef60ec047acb9ed730beb74939f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:32.364770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:32.407002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1054/2102] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:32 2022] PUT /identity/v3/projects/990427b3686547f6b46f74cba113e966/users/68b07ef60ec047acb9ed730beb74939f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:32.420884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.421175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.421457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.488362 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] MFA Rules not processed for user `68b07ef60ec047acb9ed730beb74939f`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:32.489998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:32.714313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1049/2103] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:32.718605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:32.720835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:32.907221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4aa1-bdd7-4f0b-bfd2-38cb8de50a94 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:32.920777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:32.921767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:32.922198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:32.922616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:32.938831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:32.940539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7678868-619c-4e8d-a886-9b02643b45c7 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:32.952865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1055/2104] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:33.277744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:33.284608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:33.315972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98840241-8f54-431c-8f6b-301960fcf2f0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:33.346553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:33.347281 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:33.347567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:33.347843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:33.507916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:33.509789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:33.543361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1050/2105] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:35.644001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393690-55c1-496d-8a58-a610fbb52142 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:35.644493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393690-55c1-496d-8a58-a610fbb52142 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:35.644903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393690-55c1-496d-8a58-a610fbb52142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:35.740459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-29393690-55c1-496d-8a58-a610fbb52142 None None] MFA Rules not processed for user `1521bf93314c437798ef374963def38e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:35.741933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-29393690-55c1-496d-8a58-a610fbb52142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:35.836543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1056/2106] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:35.840683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:35.842555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:35.909773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:35.910369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:35.910571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:35.934870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] MFA Rules not processed for user `5adf0f1d005d4a1eb0136d4593b094b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:35.935122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9935dd-86a5-4185-8303-60284f8bbe78 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:35.936755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:35.948216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:35.948994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:35.949674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:35.950027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:35.950873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:35.952954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.029277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1051/2107] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:35 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:36.035533 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:36.086145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1057/2108] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:36.224202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f70dad-1395-4e1d-b7e8-1004dd03486d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:36.238321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:36.239066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:36.239352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:36.239622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:36.241106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:36.243553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.282608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1052/2109] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:36 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:36.282878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:36.301788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a41f92-4d31-4016-80a1-ce7f6d7699a7 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:36.313947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:36.315243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:36.315711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:36.316139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:36.317564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:36.320111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.342302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:36.357562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1058/2110] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:36.358072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbc2a9-4aed-4425-b069-8f01286a79b5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:36.365021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:36.367860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:36.368297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:36.376190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] PATH_INFO: `/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6/users/314fce21a15547469fb2b0141d7b6c65/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:36.406084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b2abbdf50e43459596d5941eaaa4c6, user_id=314fce21a15547469fb2b0141d7b6c65, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:36.416141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.459419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:36.463016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1053/2111] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:36 2022] PUT /identity/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6/users/314fce21a15547469fb2b0141d7b6c65/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:36.477442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039e015-1df8-40fd-8c5e-3b2f5d76db75 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:36.606027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:36.607022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:36.607746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:36.608359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:36.609500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:36.611394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47a5d-9f3d-4f97-ab55-a9e3e5b66443 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.625791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1059/2112] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:36.631433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:36.658117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6251f-702f-42cf-82ad-a86493b49306 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:36.676028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:36.676828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:36.677101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:36.677368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] PATH_INFO: `/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6/users/314fce21a15547469fb2b0141d7b6c65/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:36.690316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b2abbdf50e43459596d5941eaaa4c6, user_id=314fce21a15547469fb2b0141d7b6c65, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:36.693119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4033775-af76-44e6-afb3-a67f8baaae42 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:36.709231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1054/2113] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:36 2022] PUT /identity/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6/users/314fce21a15547469fb2b0141d7b6c65/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:38.885722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:38.886790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:38.887293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:38.952401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] MFA Rules not processed for user `ddab0c5f110c41eba9629f8020db02fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:38.956189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:39.126417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1060/2114] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:39.138301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825d55-7ead-4af5-8d51-6e2a73875287 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:39.139295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825d55-7ead-4af5-8d51-6e2a73875287 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:39.139834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825d55-7ead-4af5-8d51-6e2a73875287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:39.162159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-a3825d55-7ead-4af5-8d51-6e2a73875287 None None] MFA Rules not processed for user `ddab0c5f110c41eba9629f8020db02fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:39.164644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a3825d55-7ead-4af5-8d51-6e2a73875287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:39.178542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1055/2115] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:39.192281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:39.197659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:39.325516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a4054-1abf-44d2-af31-741ce5226e5b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:39.335890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:39.336760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:39.337041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:39.337336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:39.369927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:39.373994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6b00-4d02-4ea5-9ef1-6c97be760daa service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:39.394238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1061/2116] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:39.577835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:39.578186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:39.579460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:39.601759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] MFA Rules not processed for user `30c4ac1332b64a648d7214918f757f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:39.602998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:39.748621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1056/2117] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:42.501451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9cb0f-6d3f-40b6-a847-8011713fba1b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:42.502390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9cb0f-6d3f-40b6-a847-8011713fba1b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:42.502838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9cb0f-6d3f-40b6-a847-8011713fba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:42.532149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-00b9cb0f-6d3f-40b6-a847-8011713fba1b None None] MFA Rules not processed for user `ddab0c5f110c41eba9629f8020db02fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:42.535101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-00b9cb0f-6d3f-40b6-a847-8011713fba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:42.558456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1062/2118] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:43.233163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:43.381552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6557ba7-2b5a-4082-a683-97004ff98f94 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:43.388797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:43.389922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:43.390276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:43.390740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] PATH_INFO: `/v3/users/82f3adb182ec46c09501114e9b6daeed` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:43.392233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f3adb182ec46c09501114e9b6daeed)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:43.394306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:43.527918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f3adb182ec46c09501114e9b6daeed'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:43.559493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f3adb182ec46c09501114e9b6daeed'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:43.599030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f3adb182ec46c09501114e9b6daeed'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:43.601316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f3adb182ec46c09501114e9b6daeed'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:43.627331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f3adb182ec46c09501114e9b6daeed'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:43.639392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1057/2119] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:43 2022] DELETE /identity/v3/users/82f3adb182ec46c09501114e9b6daeed => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:43.645091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff93e9-07a1-4c39-838a-992a7a151522 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:43.645704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff93e9-07a1-4c39-838a-992a7a151522 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:43.646834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff93e9-07a1-4c39-838a-992a7a151522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:43.689607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-edff93e9-07a1-4c39-838a-992a7a151522 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:43.690852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-edff93e9-07a1-4c39-838a-992a7a151522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:43.843443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1063/2120] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:44.462026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:44.463963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:44.652643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f314-46c3-405f-b281-d339b4485bb0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:44.661790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:44.667164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:44.668805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:44.669772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:44.710294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:44.712034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:44.736594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1058/2121] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:47.017725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:47.018720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:47.019275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:47.075002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] MFA Rules not processed for user `314fce21a15547469fb2b0141d7b6c65`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:47.076940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:47.095864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:47.103880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:47.135995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524289af-f23e-4324-b3af-a9e3e620976c service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:47.152949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:47.154165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:47.154598 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:47.155034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] PATH_INFO: `/v3/projects/0227cbd2e3f840b6a48c294445426f54` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:47.156784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0227cbd2e3f840b6a48c294445426f54)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:47.159834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:47.229362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1064/2122] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:47.256328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0227cbd2e3f840b6a48c294445426f54', 'request_id': 'req-f2791c84-54d8-4c49-abe9-12538325068d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.276992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0227cbd2e3f840b6a48c294445426f54', 'request_id': 'req-f2791c84-54d8-4c49-abe9-12538325068d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.291148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0227cbd2e3f840b6a48c294445426f54', 'request_id': 'req-f2791c84-54d8-4c49-abe9-12538325068d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.316064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] The token cache is being invalidate because project 0227cbd2e3f840b6a48c294445426f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:47.316636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.317647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.323539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1059/2123] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:47 2022] DELETE /identity/v3/projects/0227cbd2e3f840b6a48c294445426f54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:47.324366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:47.339522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e35cf-6770-47b3-b378-4c35bd25bfde None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:47.346320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:47.347995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:47.431478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:47.432607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:47.432948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:47.433320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] PATH_INFO: `/v3/users/68b07ef60ec047acb9ed730beb74939f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:47.436071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b07ef60ec047acb9ed730beb74939f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:47.439467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:47.536062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b07ef60ec047acb9ed730beb74939f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.537028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791c84-54d8-4c49-abe9-12538325068d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:47.545121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:47.545873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:47.546154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:47.546530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:47.547689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b07ef60ec047acb9ed730beb74939f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.548329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b07ef60ec047acb9ed730beb74939f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.548814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:47.558441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b07ef60ec047acb9ed730beb74939f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.574532 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b07ef60ec047acb9ed730beb74939f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:47.589626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1065/2124] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:47 2022] DELETE /identity/v3/users/68b07ef60ec047acb9ed730beb74939f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:47.632127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:47.634275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ab444-e45e-4240-ad1a-88d35b14c395 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:47.649007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1060/2125] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:49.052254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.054422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:49.167965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3610-f114-47ea-916d-0bf74300feda admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.176090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.176996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.177529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.178322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] PATH_INFO: `/v3/projects/990427b3686547f6b46f74cba113e966` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.182738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990427b3686547f6b46f74cba113e966)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.185753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.257881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990427b3686547f6b46f74cba113e966', 'request_id': 'req-005e4b51-e871-4c18-9fb1-a8279c0dee87'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:49.265282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990427b3686547f6b46f74cba113e966', 'request_id': 'req-005e4b51-e871-4c18-9fb1-a8279c0dee87'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:49.278929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990427b3686547f6b46f74cba113e966', 'request_id': 'req-005e4b51-e871-4c18-9fb1-a8279c0dee87'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:49.298339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] The token cache is being invalidate because project 990427b3686547f6b46f74cba113e966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:49.298893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:49.299782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-005e4b51-e871-4c18-9fb1-a8279c0dee87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:49.307757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1066/2126] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:49 2022] DELETE /identity/v3/projects/990427b3686547f6b46f74cba113e966 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:49.308083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.309440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.309731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.333615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:49.335307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:49.458477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1061/2127] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:49.460516 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.460911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.461237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.483599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:49.484918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:49.498335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1067/2128] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:49.499700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.512141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467033-011c-477a-8b0c-0b2f7d47047d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.517620 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.518238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.518522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.518831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.519711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:38:49.520226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.522405 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.536561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1062/2129] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:38:49.540991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.551801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5284-5417-4c3c-bf40-d447ccc256c9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.572436 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.573707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.573997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.574264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.575045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.577962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.642793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1068/2130] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:49 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:49.646758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.666164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e89f1-2113-443d-9f1e-1a0ed62815b6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.776665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.777289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.777579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.777909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.778640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.781298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.818120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1063/2131] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:49 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:38:49.822367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.839962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d842-db77-49c7-9d30-1900bba42e74 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.847661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.848617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.849423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.850575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.851557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.853918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.873224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.877401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1069/2132] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:49.884865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e6234-2c78-4d4f-8cb1-d079339b0943 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.889789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.890475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.893805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.893805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.893805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.893805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea334568-9209-4863-bf94-8949fa84bb66 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.914710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1064/2133] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:38:49.917382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:49.931497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23937e0-2f89-42b0-9305-a16c95e9eb1e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:49.938552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:49.940099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.940465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.940768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] PATH_INFO: `/v3/projects/7f368fc7aa6a45d5ad38b98b76e91b55/users/cf1d3952465446fbb158a764d05062a8/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.960131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f368fc7aa6a45d5ad38b98b76e91b55, user_id=cf1d3952465446fbb158a764d05062a8, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:49.962978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:49.990233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdead61-a90d-486f-bb1c-1728fcf30060 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:49.991498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdead61-a90d-486f-bb1c-1728fcf30060 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:49.991789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdead61-a90d-486f-bb1c-1728fcf30060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:49.993321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1070/2134] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:49 2022] PUT /identity/v3/projects/7f368fc7aa6a45d5ad38b98b76e91b55/users/cf1d3952465446fbb158a764d05062a8/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:50.014140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-dfdead61-a90d-486f-bb1c-1728fcf30060 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:50.015759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-dfdead61-a90d-486f-bb1c-1728fcf30060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:50.138143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1065/2135] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:50.148064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:50.151545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:50.254319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14091f-e896-425b-9931-1abc7c6d3514 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:50.265842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:50.267920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:50.268280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:50.268634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:50.288812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:50.290875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:50.309168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1071/2136] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:51.043735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.044207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.044301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.075495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] MFA Rules not processed for user `cf1d3952465446fbb158a764d05062a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:51.077739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:51.220798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1066/2137] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:51.225573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.237517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a815a5c-a23d-4d97-b58c-d6a79d67277f service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.243737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.245186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.245665 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.246870 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.248003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.250887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.293213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1072/2138] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:38:51 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:51.297830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.314015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a721-c2e1-4b41-9bb7-36b487e4ede4 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.433034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.436704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.437424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.437778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.441009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.444838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.496940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1067/2139] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:38:51 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:38:51.505531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.523213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fb254-a49e-4d8f-8d71-362484aae85f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.543595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.544497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.545029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.546328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.548406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.553752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.575927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1073/2140] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:51.580494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.600529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb44b-f780-44b8-8b19-94ab212e62e1 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.618296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.619279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.619558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.619831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] PATH_INFO: `/v3/projects/ca0e77257c8a43139406e17ca9dc2120/users/5b7534495f2e4df0b435bdafc45c746c/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.652083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0e77257c8a43139406e17ca9dc2120, user_id=5b7534495f2e4df0b435bdafc45c746c, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.655084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.698316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1068/2141] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:51 2022] PUT /identity/v3/projects/ca0e77257c8a43139406e17ca9dc2120/users/5b7534495f2e4df0b435bdafc45c746c/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:38:51.699828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.722156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9ceeb-3f4d-495e-9660-fc1b71e1ba0d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.851609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.853487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.853780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.854061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.856904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.861018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb288c29-c9c0-4a9a-a575-14ab0a966aa8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.897928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1074/2142] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:38:51.899499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:51.913114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace97386-d7b9-41bc-b1d6-d1c66a8eb183 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:51.931764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:51.932780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:51.933060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:51.933348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] PATH_INFO: `/v3/projects/ca0e77257c8a43139406e17ca9dc2120/users/5b7534495f2e4df0b435bdafc45c746c/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:51.942500 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0e77257c8a43139406e17ca9dc2120, user_id=5b7534495f2e4df0b435bdafc45c746c, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:51.945037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:51.989478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1069/2143] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:38:51 2022] PUT /identity/v3/projects/ca0e77257c8a43139406e17ca9dc2120/users/5b7534495f2e4df0b435bdafc45c746c/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:53.922776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:53.923318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:53.923318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:53.982172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] MFA Rules not processed for user `5b7534495f2e4df0b435bdafc45c746c`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:53.983478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:54.130297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1075/2144] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:38:54.144153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:54.150471 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:54.219930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cdd17-81ca-43d3-9bb0-213a6413d9ba admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:54.223951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:54.224664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:54.224936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:54.225288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:54.288940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:54.290566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:54.305201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1070/2145] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:55.692478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:55.710274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95196c7-e6a3-4fc2-88f5-219b144a6d08 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:55.714458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:55.715358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:55.715743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:55.716082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:55.728048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:55.729658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa09dc7-974f-4198-9cac-ddb1ef4d892a service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:55.741005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1076/2146] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:38:57.207112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:57.208657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:57.331062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea447-9a2b-4ff2-9093-0d11314e3c9d service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:57.336288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:57.337184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:57.337725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:57.338341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] PATH_INFO: `/v3/users/9a7d989026d044808ba64326eb482dca` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:57.339986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7d989026d044808ba64326eb482dca)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:57.351831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:57.409927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7d989026d044808ba64326eb482dca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:57.418634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7d989026d044808ba64326eb482dca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:57.432204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7d989026d044808ba64326eb482dca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:57.433286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7d989026d044808ba64326eb482dca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:57.441368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7d989026d044808ba64326eb482dca'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:57.447575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1071/2147] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:38:57 2022] DELETE /identity/v3/users/9a7d989026d044808ba64326eb482dca => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:38:57.452306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:57.452817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:57.453081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:57.471093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:38:57.472289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:57.533471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1077/2148] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:38:57.543473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:57.545025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:57.601566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc20e2-6b08-42d6-a6bb-8521c9f58e80 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:57.605134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:57.605802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:57.606063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:57.606327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:57.622088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:57.623604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:57.633725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1072/2149] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:38:58.002064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:38:58.003836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:38:58.016622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e38be9-935c-4759-8a4c-6d1fb3e7cdb8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:38:58.021734 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:38:58.022616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:38:58.023065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:38:58.023419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] PATH_INFO: `/v3/projects/d5004479d4bd4f41b2a3b0abeac8797c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:38:58.031834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5004479d4bd4f41b2a3b0abeac8797c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:38:58.033756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:38:58.095695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5004479d4bd4f41b2a3b0abeac8797c', 'request_id': 'req-9233825f-005f-496c-8c01-f31c08d1a245'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:58.103483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5004479d4bd4f41b2a3b0abeac8797c', 'request_id': 'req-9233825f-005f-496c-8c01-f31c08d1a245'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:58.119056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5004479d4bd4f41b2a3b0abeac8797c', 'request_id': 'req-9233825f-005f-496c-8c01-f31c08d1a245'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:58.135079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] The token cache is being invalidate because project d5004479d4bd4f41b2a3b0abeac8797c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:38:58.135368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:58.136124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:38:58.137804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1078/2150] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:38:58 2022] DELETE /identity/v3/projects/d5004479d4bd4f41b2a3b0abeac8797c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:09.137357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:09.139741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:09.152870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b78004-f950-40ea-9f4b-0cde3ab32995 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:09.217360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:09.218334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:09.218625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:09.218926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] PATH_INFO: `/v3/users/cf1d3952465446fbb158a764d05062a8` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:09.220267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1d3952465446fbb158a764d05062a8)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:09.222215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:09.284376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1d3952465446fbb158a764d05062a8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.293062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1d3952465446fbb158a764d05062a8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.311937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1d3952465446fbb158a764d05062a8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.312912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1d3952465446fbb158a764d05062a8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.322386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1d3952465446fbb158a764d05062a8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.332712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1073/2151] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:39:09 2022] DELETE /identity/v3/users/cf1d3952465446fbb158a764d05062a8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:09.580014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:09.581777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:09.599749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233825f-005f-496c-8c01-f31c08d1a245 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:09.691303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:09.692381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:09.692893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:09.693201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] PATH_INFO: `/v3/projects/7f368fc7aa6a45d5ad38b98b76e91b55` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:09.694570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f368fc7aa6a45d5ad38b98b76e91b55)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:09.696696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:09.759418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f368fc7aa6a45d5ad38b98b76e91b55', 'request_id': 'req-f55e8a6a-7294-4616-ac4f-74ba9999b39b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.769446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f368fc7aa6a45d5ad38b98b76e91b55', 'request_id': 'req-f55e8a6a-7294-4616-ac4f-74ba9999b39b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.780856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f368fc7aa6a45d5ad38b98b76e91b55', 'request_id': 'req-f55e8a6a-7294-4616-ac4f-74ba9999b39b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.803033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] The token cache is being invalidate because project 7f368fc7aa6a45d5ad38b98b76e91b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:39:09.803324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.804005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f55e8a6a-7294-4616-ac4f-74ba9999b39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.805692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1079/2152] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:39:09 2022] DELETE /identity/v3/projects/7f368fc7aa6a45d5ad38b98b76e91b55 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:09.809847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:09.812058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:09.828257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98b97c-4466-41b1-ab07-8178228a26f4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:09.866643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:09.866938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:09.867252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:09.892005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] MFA Rules not processed for user `5adf0f1d005d4a1eb0136d4593b094b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:09.892225 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:09.893114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:09.893230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:09.893504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:09.893844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] PATH_INFO: `/v3/users/5b7534495f2e4df0b435bdafc45c746c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:09.895555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7534495f2e4df0b435bdafc45c746c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:09.897585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:09.961283 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1080/2153] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:09.963237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7534495f2e4df0b435bdafc45c746c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.970600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7534495f2e4df0b435bdafc45c746c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.982404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7534495f2e4df0b435bdafc45c746c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.983178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7534495f2e4df0b435bdafc45c746c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:09.991988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9ad56bea-97e5-4cdd-953b-7a20eeebe361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7534495f2e4df0b435bdafc45c746c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.000485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1074/2154] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:39:09 2022] DELETE /identity/v3/users/5b7534495f2e4df0b435bdafc45c746c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:10.180146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.181617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:10.202755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc51f10-9ca4-4783-a3e0-c2e905cc18f2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.277204 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.278083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.278361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.278636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] PATH_INFO: `/v3/projects/ca0e77257c8a43139406e17ca9dc2120` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.279908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0e77257c8a43139406e17ca9dc2120)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.281874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.329978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0e77257c8a43139406e17ca9dc2120', 'request_id': 'req-d9da9fc4-5147-472f-9fa3-22373553c668'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.338148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0e77257c8a43139406e17ca9dc2120', 'request_id': 'req-d9da9fc4-5147-472f-9fa3-22373553c668'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.357934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0e77257c8a43139406e17ca9dc2120', 'request_id': 'req-d9da9fc4-5147-472f-9fa3-22373553c668'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.369506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] The token cache is being invalidate because project ca0e77257c8a43139406e17ca9dc2120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:39:10.369848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.370535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9da9fc4-5147-472f-9fa3-22373553c668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:10.379125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1081/2155] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:39:10 2022] DELETE /identity/v3/projects/ca0e77257c8a43139406e17ca9dc2120 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:10.381861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.382361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.382478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.400509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:10.401697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:10.475394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1075/2156] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:10.485208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.489098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.489612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.515517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:10.518010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:10.525613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1082/2157] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:10.530317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.541017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5f2e0-990c-45ad-b39c-569e42fafd27 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.547195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.548173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.548509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.548725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.549513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:39:10.549813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.551473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.568048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1076/2158] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:39:10.572588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.584784 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68174f51-fb10-47dc-b9d8-e6b24d5dbe3d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.595101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.596059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.596455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.596949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.597875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.600069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.629978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1083/2159] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:39:10 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:39:10.634507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.647144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c884a-724a-41b8-9675-d43981767c17 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.748239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.748829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.749342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.749619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.750334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.752563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.774849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1077/2160] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:39:10 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:39:10.778810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.793047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2eaba-1b06-4c89-a2fb-3cd2c2bbe990 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.798494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.799349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.799725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.800096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.801074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.802815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.814169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1084/2161] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:10.817989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.828424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a93d-fa8b-427e-b9da-cd7b4cbea636 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.833826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.834595 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.835105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.835540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.836287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.837904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794c92-1891-4374-8d41-3ecdf890924a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.848290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1078/2162] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:10.852813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:10.874589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35276-36b6-4bd1-b9f9-005ae8aeb84d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:10.880206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:10.881345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.881581 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.881863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] PATH_INFO: `/v3/projects/973bf63a8fc04416a592f2dad60e36aa/users/e4e0adf42781443d9278b0d19b63f16e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.899252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] RBAC: Authorizing `identity:create_grant(project_id=973bf63a8fc04416a592f2dad60e36aa, user_id=e4e0adf42781443d9278b0d19b63f16e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:10.902607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:10.925238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1085/2163] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:39:10 2022] PUT /identity/v3/projects/973bf63a8fc04416a592f2dad60e36aa/users/e4e0adf42781443d9278b0d19b63f16e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:39:10.936386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:10.936808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:10.937089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:10.964605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] MFA Rules not processed for user `e4e0adf42781443d9278b0d19b63f16e`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:10.966051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:11.051691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1079/2164] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:39:11.061702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:11.063698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:11.139121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3dd9b-926a-435e-bd42-9392386d096a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:11.143121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:11.143786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:11.144074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:11.144439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:11.156702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:11.158443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1704bb-a562-4814-bad1-c407682f476e service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:11.169515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1086/2165] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:11.191938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:11.256371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4c3bb-c642-4687-b52d-4b5aa0f2bd83 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:11.261133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:11.262026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:11.262312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:11.262585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] PATH_INFO: `/v3/users/e4e0adf42781443d9278b0d19b63f16e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:11.263848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e0adf42781443d9278b0d19b63f16e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:11.265967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:11.314382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e0adf42781443d9278b0d19b63f16e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:11.323023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e0adf42781443d9278b0d19b63f16e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:11.335884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e0adf42781443d9278b0d19b63f16e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:11.336625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e0adf42781443d9278b0d19b63f16e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:11.345026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e0adf42781443d9278b0d19b63f16e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:11.351625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1080/2166] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:39:11 2022] DELETE /identity/v3/users/e4e0adf42781443d9278b0d19b63f16e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:11.355964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:11.356253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:11.356530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:11.375036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:11.376222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:11.450097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1087/2167] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:11.460126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:11.461597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:11.520379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5ad5-b4ef-4eb9-9033-8ce0e2107a68 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:11.527789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:11.527789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:11.527789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:11.527789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:11.535683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:11.537116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7f7cd-404c-410c-b2aa-702d3252ec39 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:11.546488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1081/2168] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:11.926889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:11.931726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:11.964595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e4ea-e378-4120-81f0-a8e0f0303804 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:11.977589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:11.978978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:11.988071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:11.989803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] PATH_INFO: `/v3/projects/973bf63a8fc04416a592f2dad60e36aa` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:11.992646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=973bf63a8fc04416a592f2dad60e36aa)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:11.995039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.061649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973bf63a8fc04416a592f2dad60e36aa', 'request_id': 'req-9f8c522e-12c9-489a-8486-bf856331c52b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.069848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973bf63a8fc04416a592f2dad60e36aa', 'request_id': 'req-9f8c522e-12c9-489a-8486-bf856331c52b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.080077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973bf63a8fc04416a592f2dad60e36aa', 'request_id': 'req-9f8c522e-12c9-489a-8486-bf856331c52b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.103533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] The token cache is being invalidate because project 973bf63a8fc04416a592f2dad60e36aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:39:12.104618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.105448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-9f8c522e-12c9-489a-8486-bf856331c52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.108249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1088/2169] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:39:11 2022] DELETE /identity/v3/projects/973bf63a8fc04416a592f2dad60e36aa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:12.113233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.113520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.113791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.138101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:12.139881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:12.224614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1082/2170] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:12.228772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.229123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.229427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.252589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:12.253807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:12.267559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1089/2171] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:12.271661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.281801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33511-2d38-4d79-beb0-4a2e50d19bf0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.289776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.289776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.289776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.289776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.290128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:39:12.290128 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.291093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.309255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1083/2172] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:39:12.314028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.323511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9ff0-9072-4942-9beb-7b473904bf52 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.328673 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.329374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.329655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.329978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.330782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.332663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.362716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1090/2173] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:39:12.367228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.377696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ffe0a-6760-4202-bfe1-f56bc449cce6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.432480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.433173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.433445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.433708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.434507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.436450 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.457573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1084/2174] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:39:12.461934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.472305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789e68-bc09-4e77-9de6-2ea773834cd4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.477096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.477755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.478040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.478396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.479193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.480816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.493178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1091/2175] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:12.496972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.507230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a955-1d82-4019-bb42-c5ef10aff9ca admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.512012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.512680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.512959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.513229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.513966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.515657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d864ff7-d046-4c2a-a9b2-652c4f70d982 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.526339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1085/2176] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:12.530739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.541431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eed66-7b1d-442c-a6c4-7c9e1747f078 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.551477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.552832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.553195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.553483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] PATH_INFO: `/v3/projects/8bc6803b8ee44237a3d3c3e0ce6e2353/users/9cd41ed0f996422cbef7f433431561a0/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.570968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc6803b8ee44237a3d3c3e0ce6e2353, user_id=9cd41ed0f996422cbef7f433431561a0, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.573587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.599565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1092/2177] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:39:12 2022] PUT /identity/v3/projects/8bc6803b8ee44237a3d3c3e0ce6e2353/users/9cd41ed0f996422cbef7f433431561a0/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:12.601397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.601683 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.601986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.632431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] MFA Rules not processed for user `9cd41ed0f996422cbef7f433431561a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:12.633635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:12.699664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1086/2178] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:12.730693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.733192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:12.788797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba694d-eefc-4c2e-a9b6-79229704e5a7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.792769 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.793590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.793877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.794145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.802978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.804599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b76e0-5a4c-4821-8a7c-9acf492211a2 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.814074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1093/2179] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:12.829004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:12.895290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806e462-024f-4498-afee-6e45d1f5bf73 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:12.899963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:12.901203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.901203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.901484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] PATH_INFO: `/v3/users/9cd41ed0f996422cbef7f433431561a0` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:12.902752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd41ed0f996422cbef7f433431561a0)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:12.904685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:12.951780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd41ed0f996422cbef7f433431561a0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.958994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd41ed0f996422cbef7f433431561a0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.971877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd41ed0f996422cbef7f433431561a0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.972470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd41ed0f996422cbef7f433431561a0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.987066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd41ed0f996422cbef7f433431561a0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:12.996680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1087/2180] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:39:12 2022] DELETE /identity/v3/users/9cd41ed0f996422cbef7f433431561a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:39:12.998707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:12.999260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:12.999497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:13.017986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:13.019486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:13.079228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1094/2181] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:13.088619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:13.090055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:13.147962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9c1c-e372-4dbe-a289-e3f60f1a208e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:13.151719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:13.152372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:13.152657 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:13.152929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:13.162311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:13.163879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fc9fa-745c-4141-971c-ca803c756685 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:13.173536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1088/2182] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:13.451553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:13.453049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:13.465334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2705ba-a30d-4826-85c4-450879306e7d None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:13.470295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:13.471213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:13.471497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:13.471776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] PATH_INFO: `/v3/projects/8bc6803b8ee44237a3d3c3e0ce6e2353` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:13.472994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc6803b8ee44237a3d3c3e0ce6e2353)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:13.474933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:13.521787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc6803b8ee44237a3d3c3e0ce6e2353', 'request_id': 'req-ce280b06-1c63-4d20-8759-7d34383eea14'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:13.527090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc6803b8ee44237a3d3c3e0ce6e2353', 'request_id': 'req-ce280b06-1c63-4d20-8759-7d34383eea14'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:13.536710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc6803b8ee44237a3d3c3e0ce6e2353', 'request_id': 'req-ce280b06-1c63-4d20-8759-7d34383eea14'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:13.547599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] The token cache is being invalidate because project 8bc6803b8ee44237a3d3c3e0ce6e2353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:39:13.547902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:13.548560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:13.550225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1095/2183] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:39:13 2022] DELETE /identity/v3/projects/8bc6803b8ee44237a3d3c3e0ce6e2353 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:17.375819 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804638b-efca-4c16-98a5-ea9aaec0ef75 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:17.376301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804638b-efca-4c16-98a5-ea9aaec0ef75 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:17.376389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804638b-efca-4c16-98a5-ea9aaec0ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:17.394996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d804638b-efca-4c16-98a5-ea9aaec0ef75 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:17.396199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d804638b-efca-4c16-98a5-ea9aaec0ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:17.470133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1089/2184] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:17.484367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:17.486274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:17.567540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce280b06-1c63-4d20-8759-7d34383eea14 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:17.573378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:17.574041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:17.574367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:17.574795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:17.584873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:17.586623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e6940-2052-47ba-a1db-5ff3fb32bc63 service swift] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:17.596494 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1096/2185] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:39:18.232061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:18.232353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:18.232635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:18.252578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] MFA Rules not processed for user `1521bf93314c437798ef374963def38e`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:18.253793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:18.314261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1090/2186] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:30.723333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a1f8-5b48-4029-a574-b8511f869fa8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:30.724348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a1f8-5b48-4029-a574-b8511f869fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:30.724822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a1f8-5b48-4029-a574-b8511f869fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:30.760557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3650a1f8-5b48-4029-a574-b8511f869fa8 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:30.761893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3650a1f8-5b48-4029-a574-b8511f869fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:30.770693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1097/2187] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:30.789196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:30.805165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a41487-6d57-438a-96b1-802cd8d95f84 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:30.812456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:30.813940 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:30.814773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:30.815067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:30.829856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:30.832138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:30.844121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1091/2188] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:39:37.864787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:37.865312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:37.865312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:37.885386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:37.895194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:37.908372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1098/2189] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:39:37.916540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:37.927354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4cc1-2738-4da2-91c6-b194d304f59a service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:37.932539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:37.933201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:37.933475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:37.933744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:37.951953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:37.954328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:37.973812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1092/2190] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:39:40.613957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:40.616232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:40.731974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5d51-20f5-460c-a8fb-ad194f2a5235 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:40.760590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:40.763791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:40.764081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:40.764361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] PATH_INFO: `/v3/users/30c4ac1332b64a648d7214918f757f83` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:40.766422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c4ac1332b64a648d7214918f757f83)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:40.768461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:40.827614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c4ac1332b64a648d7214918f757f83'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:40.841694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c4ac1332b64a648d7214918f757f83'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:40.843220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c4ac1332b64a648d7214918f757f83'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:40.851586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c4ac1332b64a648d7214918f757f83'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:40.864515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-71f3312e-8d52-4ee1-8b06-445d7a1c02d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c4ac1332b64a648d7214918f757f83'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:40.871164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1099/2191] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:39:40 2022] DELETE /identity/v3/users/30c4ac1332b64a648d7214918f757f83 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:39:41.087962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.101087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3316cf-2431-4f7f-a493-bbdde12f37ea service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.204523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.206906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.212294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.212875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] PATH_INFO: `/v3/projects/b5f20a9d15eb4d99bf667578a36a9f55` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.215482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f20a9d15eb4d99bf667578a36a9f55)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.219167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.288541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f20a9d15eb4d99bf667578a36a9f55', 'request_id': 'req-68e0fb74-e3b0-47e9-9763-68d064f35ca4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:41.298024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f20a9d15eb4d99bf667578a36a9f55', 'request_id': 'req-68e0fb74-e3b0-47e9-9763-68d064f35ca4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:41.312729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f20a9d15eb4d99bf667578a36a9f55', 'request_id': 'req-68e0fb74-e3b0-47e9-9763-68d064f35ca4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:41.329828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] The token cache is being invalidate because project b5f20a9d15eb4d99bf667578a36a9f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:39:41.330122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:41.330978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-68e0fb74-e3b0-47e9-9763-68d064f35ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:39:41.332699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1093/2192] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:39:41 2022] DELETE /identity/v3/projects/b5f20a9d15eb4d99bf667578a36a9f55 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:39:41.337629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.337919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.338198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.361160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:41.362399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:41.445997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1100/2193] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:41.448848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.449366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.449829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.499803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:41.501215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:41.512051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1094/2194] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:41.515380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.529183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2164e74-734a-4036-9c43-5a0d583807de None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.540812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.541536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.541797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.542070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.545677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:39:41.546019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.547724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.581316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1101/2195] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:39:41.582476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.594125 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f58c-ef41-4ae0-b5a2-062c93e186f9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.601623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.602307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.602588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.603062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.603807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.605765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.652818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1095/2196] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:39:41 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:39:41.653931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.667371 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cad1c-010a-4e6d-bc47-f312e41a27de admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.736890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.737909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.739029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.739505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.740409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.742539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.772361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1102/2197] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:39:41 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:39:41.776154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.786694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9186f-a6d0-4c1e-b87a-f0532c1b3855 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.791457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.792148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.792421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.792692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.794548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.795167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.814088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1096/2198] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:41.815548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.842491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22baab-7c85-4ba3-a5c7-a18d8056ed45 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.858050 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.858953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.859239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.859492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.860605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.862875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b086fc4-e0d8-46b5-8a80-2eb73645cf2e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.880089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1103/2199] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:39:41.881294 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:41.892253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62787d8-3891-484e-bfac-4baad63d2c04 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:41.901164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:41.902123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.902397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.902680 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] PATH_INFO: `/v3/projects/f4961258989e47c8a22a1dacd7791988/users/592c11f7234741f1ae18cc7a5992395a/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.920244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4961258989e47c8a22a1dacd7791988, user_id=592c11f7234741f1ae18cc7a5992395a, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:41.923881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:41.942516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1097/2200] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:39:41 2022] PUT /identity/v3/projects/f4961258989e47c8a22a1dacd7791988/users/592c11f7234741f1ae18cc7a5992395a/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:39:41.953064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:41.953359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:41.953847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:41.996375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] MFA Rules not processed for user `592c11f7234741f1ae18cc7a5992395a`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:41.998981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:42.097045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1104/2201] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:42.109438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:42.111414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:42.172529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857b27-1665-45bc-bfc2-9d73b3d14189 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:42.176289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:42.176943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:42.177223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:42.177496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:42.186873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:42.188389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eb806-5bb7-4f16-a33b-aad12237f2ab service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:42.199280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1098/2202] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:44.244309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:44.247978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:44.311119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e2b8-b6e5-4c03-bc83-63776f0db6e8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:44.315613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:44.316321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:44.316749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:44.317031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:44.318914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:44.388815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:44.390359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498fae3-52e8-4188-ba56-0aa3b0146d78 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:44.401229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1105/2203] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:48.536012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.536563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.536763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.539332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1099/2204] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:39:48.546495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f918-54a4-452d-a6fb-a446aa196125 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.547041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f918-54a4-452d-a6fb-a446aa196125 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.547126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f918-54a4-452d-a6fb-a446aa196125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.565546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8882f918-54a4-452d-a6fb-a446aa196125 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:48.566789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8882f918-54a4-452d-a6fb-a446aa196125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:48.631553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1106/2205] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:48.644329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:48.645881 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:48.709967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe48795-a9a1-43db-97f6-0e6997c29f46 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:48.713647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:48.714310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.714624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.715080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.725796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:48.727337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63910eca-e12e-4b9d-89ce-46899a3d6292 service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:48.739278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1100/2206] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:48.814817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4a4f-4cd2-49a3-b9a8-1e60d3bf2f45 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.815002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4a4f-4cd2-49a3-b9a8-1e60d3bf2f45 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.815282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4a4f-4cd2-49a3-b9a8-1e60d3bf2f45 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.817061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1107/2207] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:39:48.822520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f879e-440c-4854-a7d1-1c4c74eefc4e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.822849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f879e-440c-4854-a7d1-1c4c74eefc4e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.823129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f879e-440c-4854-a7d1-1c4c74eefc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.846528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-3c2f879e-440c-4854-a7d1-1c4c74eefc4e None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:48.847835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3c2f879e-440c-4854-a7d1-1c4c74eefc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:48.854387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1101/2208] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:48.867812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4a4f-4cd2-49a3-b9a8-1e60d3bf2f45 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:48.880267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4a4f-4cd2-49a3-b9a8-1e60d3bf2f45 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:48.885689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:48.886423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:48.886950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:48.887247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:48.895688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:48.897409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcd8ce-47a1-4694-a627-82e8a671501d service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:48.907123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1108/2209] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:49.001821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd798-0812-48fc-922c-49d2bfe63f89 None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:49.002392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd798-0812-48fc-922c-49d2bfe63f89 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:49.002718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd798-0812-48fc-922c-49d2bfe63f89 None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:49.004499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1102/2210] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:39:49.010583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabcb2-bdba-4834-9a88-0a96be4e35b3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:49.010911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabcb2-bdba-4834-9a88-0a96be4e35b3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:49.011192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fabcb2-bdba-4834-9a88-0a96be4e35b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:49.030819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-36fabcb2-bdba-4834-9a88-0a96be4e35b3 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:49.032330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-36fabcb2-bdba-4834-9a88-0a96be4e35b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:49.043240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1109/2211] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:49.054259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dd798-0812-48fc-922c-49d2bfe63f89 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:49.074904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dd798-0812-48fc-922c-49d2bfe63f89 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:49.089269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:49.089269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:49.089269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:49.089269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:49.096210 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:49.097711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:49.121373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1103/2212] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:39:56.425156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687971-3a82-46e9-8ad3-df57a132ac44 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:56.425635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687971-3a82-46e9-8ad3-df57a132ac44 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:56.425824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687971-3a82-46e9-8ad3-df57a132ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:56.454168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-56687971-3a82-46e9-8ad3-df57a132ac44 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:39:56.456098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-56687971-3a82-46e9-8ad3-df57a132ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:56.531499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1110/2213] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:39:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:39:56.543874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:39:56.545576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:39:56.646091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a872d3-9680-4c57-86a3-8832cdd8ae56 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:39:56.652005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:39:56.652660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:39:56.652935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:39:56.653196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:39:56.661867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:39:56.663489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:39:56.673835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1104/2214] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:39:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:19.214444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:19.214977 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:19.215073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:19.247229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:19.248463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:19.257139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1111/2215] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:40:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:19.269710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:19.280027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f27aa-c031-433c-9382-811c90dfc1a2 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:19.285602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:19.286240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:19.286515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:19.286805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:19.295946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:19.297732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:19.306782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1105/2216] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:19.825470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:19.827210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:19.939747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f286b5-7a52-44f4-b461-19344bbff55a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:19.944563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:19.945394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:19.945676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:19.945944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] PATH_INFO: `/v3/users/5adf0f1d005d4a1eb0136d4593b094b5` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:19.947213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adf0f1d005d4a1eb0136d4593b094b5)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:19.949386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:19.997273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adf0f1d005d4a1eb0136d4593b094b5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.005669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adf0f1d005d4a1eb0136d4593b094b5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.006286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adf0f1d005d4a1eb0136d4593b094b5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.014025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adf0f1d005d4a1eb0136d4593b094b5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.026452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e9afc8ef-0895-49ce-bd49-eb240fd80c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adf0f1d005d4a1eb0136d4593b094b5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.032394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1112/2217] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:19 2022] DELETE /identity/v3/users/5adf0f1d005d4a1eb0136d4593b094b5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:20.218356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.230111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af1d0d-cc43-49dd-91c1-3e707a966c01 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.295279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.296143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.296420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.296687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] PATH_INFO: `/v3/projects/d7bf7bed71094487b57906e39d043543` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.297870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bf7bed71094487b57906e39d043543)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.299865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.345107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bf7bed71094487b57906e39d043543', 'request_id': 'req-8ac32465-64c5-4186-b5b0-9723bc04eb82'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.350804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bf7bed71094487b57906e39d043543', 'request_id': 'req-8ac32465-64c5-4186-b5b0-9723bc04eb82'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.359396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bf7bed71094487b57906e39d043543', 'request_id': 'req-8ac32465-64c5-4186-b5b0-9723bc04eb82'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.371649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] The token cache is being invalidate because project d7bf7bed71094487b57906e39d043543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:20.371962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.372630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-8ac32465-64c5-4186-b5b0-9723bc04eb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:20.374250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1106/2218] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:20 2022] DELETE /identity/v3/projects/d7bf7bed71094487b57906e39d043543 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:20.379957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.380472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.380472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.440388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:20.441609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:20.503020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1113/2219] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:20.515919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.516273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.516559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.535755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:20.537374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:20.546965 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1107/2220] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:20.552322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.572351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a95a67-f152-4086-ac98-01b8a98bfcd1 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.577380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.578039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.578314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.578634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.579423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:20.579729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.581434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.592702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1114/2221] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:20.598113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.607474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ecc73-b9ac-45bf-b51d-3973c5cd73ea None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.612236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.613001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.613279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.613555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.614280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.616326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.647498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1108/2222] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:20 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:20.652180 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.664010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ca31-ef62-488d-bd7d-f5be8656ac2b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.720805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.721515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.721789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.722051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.722844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.724856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.749294 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1115/2223] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:20 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:20.753766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.764449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4612-8a79-49ce-b035-b8a03bbb9c1d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.769728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.770379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.770681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.770953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.771729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.773327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.783769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1109/2224] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:20.787888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.797883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074445-924a-43e1-8b9b-b49e1854496f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.803173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.803830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.804100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.804366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.805140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.806766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbd6ed-64bf-43f2-879f-15904129238c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.818509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1116/2225] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:20.822804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:20.832901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc447-91cb-4849-8c72-4dd56230406b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:20.838130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:20.839061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.839325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.839594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] PATH_INFO: `/v3/projects/781c646a201a4da88e40890261bca042/users/498d5697b25f40f198ff8275f7407cdf/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.857317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781c646a201a4da88e40890261bca042, user_id=498d5697b25f40f198ff8275f7407cdf, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:20.860041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:20.875570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1110/2226] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:20 2022] PUT /identity/v3/projects/781c646a201a4da88e40890261bca042/users/498d5697b25f40f198ff8275f7407cdf/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:20.887251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:20.887642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:20.887990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:20.915453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] MFA Rules not processed for user `498d5697b25f40f198ff8275f7407cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:20.916767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:20.994370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1117/2227] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:21.006232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:21.008335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:21.081445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d9f5-51dd-468c-9009-edc2e77f0621 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:21.087558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:21.088209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:21.088475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:21.088745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:21.096974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:21.098630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ca82-4cfc-40fa-957a-a1becfb811f2 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:21.108074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1111/2228] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:21.599802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:21.601484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:21.669438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902339da-4bbb-4623-96ce-024e16c6ef33 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:21.674929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:21.675794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:21.676081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:21.676351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] PATH_INFO: `/v3/users/592c11f7234741f1ae18cc7a5992395a` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:21.677663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=592c11f7234741f1ae18cc7a5992395a)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:21.680063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:21.728268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592c11f7234741f1ae18cc7a5992395a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:21.735859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592c11f7234741f1ae18cc7a5992395a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:21.736493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592c11f7234741f1ae18cc7a5992395a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:21.743257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592c11f7234741f1ae18cc7a5992395a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:21.756057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592c11f7234741f1ae18cc7a5992395a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:21.762364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1118/2229] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:21 2022] DELETE /identity/v3/users/592c11f7234741f1ae18cc7a5992395a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:21.767306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:21.767813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:21.767813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:21.785641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:21.786885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:21.843013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1112/2230] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:21.855381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:21.856812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:21.938120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60147dab-aff2-4e31-ba8b-32c2d3d5dc0e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:21.942308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:21.942978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:21.943255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:21.943528 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:21.953052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:21.954551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66cb58-825b-47ae-9193-51d9e008b016 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:21.964301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1119/2231] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:22.224889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.226445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:22.239526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53ce8-0b6e-4988-91dd-9aafd4510029 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.245489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.246485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.246868 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.247205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] PATH_INFO: `/v3/projects/f4961258989e47c8a22a1dacd7791988` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.248569 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4961258989e47c8a22a1dacd7791988)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.250480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.297615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4961258989e47c8a22a1dacd7791988', 'request_id': 'req-d32c703a-a4f1-40eb-acfc-53c3b4b12186'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:22.302953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4961258989e47c8a22a1dacd7791988', 'request_id': 'req-d32c703a-a4f1-40eb-acfc-53c3b4b12186'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:22.312296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4961258989e47c8a22a1dacd7791988', 'request_id': 'req-d32c703a-a4f1-40eb-acfc-53c3b4b12186'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:22.323069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] The token cache is being invalidate because project f4961258989e47c8a22a1dacd7791988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:22.323350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:22.323960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d32c703a-a4f1-40eb-acfc-53c3b4b12186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:22.325493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1113/2232] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:22 2022] DELETE /identity/v3/projects/f4961258989e47c8a22a1dacd7791988 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:22.330514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.330832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.331100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.348811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:22.349931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:22.419342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1120/2233] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:22.428380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.428659 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.428936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.448534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:22.449662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:22.458682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1114/2234] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:22.463133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.473275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e0a0a-0950-43f2-a42c-64b587904589 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.478992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.479305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.479586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.479857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.480600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:22.480911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.482523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.495500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1121/2235] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:22.500123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.509619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3775b-2bc6-47b0-8d85-0fd103a91000 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.514765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.515479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.515758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.516029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.516750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.518900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.554689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1115/2236] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:22 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:22.558266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.569181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0209c7-fb3b-4df4-a9ae-6334891b21a8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.631623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.633531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.633827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.634096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.634877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.636996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.657820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1122/2237] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:22 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:22.662198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.677691 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad44d9-0110-43c8-8b78-96727adb0ba7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.683886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.684641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.685104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.685468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.686899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.698211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.710374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1116/2238] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:22.714295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.725542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e6ac0-d4cf-4c3b-9f31-11591520d8c8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.730238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.730934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.731353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.731630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.732398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.734085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc0c3-d078-4a32-ab35-730b312a6153 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.746681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1123/2239] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:22.750931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.761382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7877a-639f-4a28-9253-d5d0319120c3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.766397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.767527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.768057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.768057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] PATH_INFO: `/v3/projects/397937135c724f219fed7bcf99e966a2/users/5d0722764d2442bcb45a99e2f3020caf/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.785057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=397937135c724f219fed7bcf99e966a2, user_id=5d0722764d2442bcb45a99e2f3020caf, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.787833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:22.801942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1117/2240] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:22 2022] PUT /identity/v3/projects/397937135c724f219fed7bcf99e966a2/users/5d0722764d2442bcb45a99e2f3020caf/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:22.814534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.814534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.814534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.840017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] MFA Rules not processed for user `5d0722764d2442bcb45a99e2f3020caf`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:22.841209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:22.906206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1124/2241] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:22.916751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:22.918707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:22.983019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc884-ade1-44c1-86a5-cd9b756b9efb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:22.987566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:22.988222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:22.988505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:22.988849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:22.998363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:22.999842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528076c-63a8-4c9c-8374-d72aaa63a71a service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.008906 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1118/2242] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:23.035375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.111313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe95d8-c10e-4e59-8381-c4cfef1fb417 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:23.116396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:23.117280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.117559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.117828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] PATH_INFO: `/v3/users/5d0722764d2442bcb45a99e2f3020caf` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.119167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0722764d2442bcb45a99e2f3020caf)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:23.121554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.171181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0722764d2442bcb45a99e2f3020caf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.179289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0722764d2442bcb45a99e2f3020caf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.179880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0722764d2442bcb45a99e2f3020caf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.186301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0722764d2442bcb45a99e2f3020caf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.197076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0722764d2442bcb45a99e2f3020caf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.202765 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1125/2243] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:23 2022] DELETE /identity/v3/users/5d0722764d2442bcb45a99e2f3020caf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:23.207466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.207751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.208024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.225099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:23.226304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:23.283466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1119/2244] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:23.294280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.296117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:23.353278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa5126-7e9f-4a5a-9d99-91c3af89107e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:23.357365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:23.358015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.358302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.358560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.368177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:23.369618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe1fd8-deab-41fe-837e-ff9addb0b78d service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.379344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1126/2245] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:23.652272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.653782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:23.675576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed85f-514a-4423-9325-21432b6bbcc3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:23.682311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:23.683231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.683539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.683811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] PATH_INFO: `/v3/projects/397937135c724f219fed7bcf99e966a2` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.687454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397937135c724f219fed7bcf99e966a2)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:23.689509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.737963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397937135c724f219fed7bcf99e966a2', 'request_id': 'req-c0bbd4d9-a336-4aa7-98bd-4089622019d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.744101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397937135c724f219fed7bcf99e966a2', 'request_id': 'req-c0bbd4d9-a336-4aa7-98bd-4089622019d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.754869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397937135c724f219fed7bcf99e966a2', 'request_id': 'req-c0bbd4d9-a336-4aa7-98bd-4089622019d2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.766279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] The token cache is being invalidate because project 397937135c724f219fed7bcf99e966a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:23.766558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.767257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-c0bbd4d9-a336-4aa7-98bd-4089622019d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:23.768808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1120/2246] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:23 2022] DELETE /identity/v3/projects/397937135c724f219fed7bcf99e966a2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:23.773739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.774137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.774312 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.791564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:23.792740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:23.852586 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1127/2247] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:23.860327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.860724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.861009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.879685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:23.880892 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:23.890404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1121/2248] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:23.894676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.904447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845e1e-e5ff-4438-ad06-b0df4f7a6fec None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:23.909457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:23.910106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.910389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.910683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.911443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:23.911748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:23.913348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.924762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1128/2249] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:23.929249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.939262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd8a1b-3251-4e2a-bc73-03ad6c8904fd None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:23.945273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:23.945956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:23.946237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:23.946508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:23.947249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:23.949157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:23.977547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1122/2250] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:23.981998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:23.992643 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49267ecc-b323-4f96-805d-926e22659e7d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:24.057989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:24.058682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.058971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.059299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.060041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:24.062015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:24.083898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1129/2251] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:23 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:24.088688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:24.099882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87678-bb94-4a29-9762-01ed4d795d3c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:24.105262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:24.105931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.106205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.106472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.107244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:24.108856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:24.119479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1123/2252] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:24.124108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:24.134287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cce9-debf-4cbf-a30f-08aa12eafc18 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:24.139486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:24.140140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.140420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.140718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.141447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:24.143163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98adb-c8e6-48b4-bdbd-3bea4991dadb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:24.153169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1130/2253] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:40:24.157172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:24.167049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf0a7c-8505-4b2a-9997-c4f1e3e0ff03 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:24.172118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:24.172988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.173323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.173593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] PATH_INFO: `/v3/projects/f8d44d08ec564e94b99156087796bf3d/users/3117cb6d65454365be315814d9d696cc/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.188926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d44d08ec564e94b99156087796bf3d, user_id=3117cb6d65454365be315814d9d696cc, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:24.191607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:24.209648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1124/2254] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:24 2022] PUT /identity/v3/projects/f8d44d08ec564e94b99156087796bf3d/users/3117cb6d65454365be315814d9d696cc/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:24.214941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.215234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.215510 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.233696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:24.234913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:24.295188 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1131/2255] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:24.307044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:24.310174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:24.369862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f86c-9265-4920-abcb-64a249faa594 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:24.374535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:24.375241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:24.375514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:24.375781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:24.385589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:24.387110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a73d39-36f1-48b9-97bc-3900bf3b9dab service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:24.396731 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1125/2256] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:28.471249 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:28.472880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:28.486124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1381f-f98f-40f2-b879-2092ad7ce8c4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:28.492664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:28.501500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:28.513223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:28.513223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] PATH_INFO: `/v3/users/498d5697b25f40f198ff8275f7407cdf` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:28.515938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] RBAC: Authorizing `identity:delete_user(user_id=498d5697b25f40f198ff8275f7407cdf)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:28.518610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:28.580227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498d5697b25f40f198ff8275f7407cdf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:28.594598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498d5697b25f40f198ff8275f7407cdf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:28.596013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498d5697b25f40f198ff8275f7407cdf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:28.608351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498d5697b25f40f198ff8275f7407cdf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:28.621500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498d5697b25f40f198ff8275f7407cdf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:28.628892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1132/2257] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:28 2022] DELETE /identity/v3/users/498d5697b25f40f198ff8275f7407cdf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:28.633936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf955-0ba6-4452-8e08-94ece19ae554 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:28.634475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf955-0ba6-4452-8e08-94ece19ae554 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:28.634575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf955-0ba6-4452-8e08-94ece19ae554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:28.670473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b11cf955-0ba6-4452-8e08-94ece19ae554 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:28.673810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b11cf955-0ba6-4452-8e08-94ece19ae554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:28.790526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1126/2258] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:28.798332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:28.799836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:28.882972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef716-1d71-47bc-a015-4154942e59af admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:28.888797 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:28.889480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:28.889763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:28.890046 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:28.900079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:28.901540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:28.916473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1133/2259] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:29.129839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.130131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.130406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.172810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] MFA Rules not processed for user `3117cb6d65454365be315814d9d696cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:29.175240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.261694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1127/2260] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:29.271739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.275863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.298596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f931eb-6351-4e35-9f18-ca3a327bf2da service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.310966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.311650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.311931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.312203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.312916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.314921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.327637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.330127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.353083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1134/2261] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:29.360554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ed53d-34d2-44f4-8d30-a3acc5582996 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.364299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.426367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.427549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.427829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.428103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] PATH_INFO: `/v3/projects/781c646a201a4da88e40890261bca042` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.428669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee75cc-dd63-4383-9a97-7471e665f497 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.429319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] RBAC: Authorizing `identity:delete_project(project_id=781c646a201a4da88e40890261bca042)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.431343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.433834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.434344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.434725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.435158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.435856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.438104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.461085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1135/2262] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:29.466117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.476020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972db36-1b97-40ac-a295-99380412170c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.481575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781c646a201a4da88e40890261bca042', 'request_id': 'req-87c99f82-1eb5-49b2-b4c8-037329e7639a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:29.487688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781c646a201a4da88e40890261bca042', 'request_id': 'req-87c99f82-1eb5-49b2-b4c8-037329e7639a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:29.497911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781c646a201a4da88e40890261bca042', 'request_id': 'req-87c99f82-1eb5-49b2-b4c8-037329e7639a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:29.509363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] The token cache is being invalidate because project 781c646a201a4da88e40890261bca042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:29.509690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:29.510334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-87c99f82-1eb5-49b2-b4c8-037329e7639a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:29.512202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1128/2263] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:29 2022] DELETE /identity/v3/projects/781c646a201a4da88e40890261bca042 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:29.517406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01080279-f96f-41d0-93cf-c26c6b7c3f88 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.517406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01080279-f96f-41d0-93cf-c26c6b7c3f88 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.517697 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01080279-f96f-41d0-93cf-c26c6b7c3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.535823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-01080279-f96f-41d0-93cf-c26c6b7c3f88 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:29.537090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-01080279-f96f-41d0-93cf-c26c6b7c3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.539066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.539849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.540242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.540847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.541690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.543431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.550966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1129/2264] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:29.552954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.553237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.553505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.554213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1136/2265] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:29.558503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.560718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.573041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:29.573667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca72bf0-6bd9-4ec8-ae2d-2a52a7bdc590 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.574214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:29.581052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.581987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.582172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1130/2266] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:29.582287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.582530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] PATH_INFO: `/v3/projects/044916832bf14a368645d7af3f9c7da4/users/9c2cfa9e6fb148b49facd7c2c67ebd4f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.586550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.595154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5cfe-680f-45e4-a758-e0eee5f31874 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.599977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.600638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.600911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.601258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.601939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:29.602238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.602519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044916832bf14a368645d7af3f9c7da4, user_id=9c2cfa9e6fb148b49facd7c2c67ebd4f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.603872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.605222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.616134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1131/2267] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:29.620645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.621688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1137/2268] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:29 2022] PUT /identity/v3/projects/044916832bf14a368645d7af3f9c7da4/users/9c2cfa9e6fb148b49facd7c2c67ebd4f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:29.625679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.630418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a53834-c98a-4cdf-9a27-6a4609c1f13b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.688823 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc7cc-80c8-495d-97d5-7d97bd6aba15 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.694595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.695319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.695603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.695876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.696622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.696837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.697514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.697794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.698220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.698341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.699070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.700998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.709576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1138/2269] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:29.713711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.723346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ec75-7006-4e86-bbf3-a30e290bd63f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.728308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.729215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.729491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.729763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] PATH_INFO: `/v3/projects/044916832bf14a368645d7af3f9c7da4/users/9c2cfa9e6fb148b49facd7c2c67ebd4f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.731834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044916832bf14a368645d7af3f9c7da4, user_id=9c2cfa9e6fb148b49facd7c2c67ebd4f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.734465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.739537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1132/2270] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:29.743713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.746645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1139/2271] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:29 2022] PUT /identity/v3/projects/044916832bf14a368645d7af3f9c7da4/users/9c2cfa9e6fb148b49facd7c2c67ebd4f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:29.820561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e56f9-7d7f-4d1a-8622-d8d5b6caa429 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.887351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.888162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.888419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.888724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.889470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.891440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.914144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1133/2272] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:29 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:29.918035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.930557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13245-5e9c-4752-8557-10bc555298d0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.935631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.936327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.936718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.936864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.937635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.939296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.950685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1140/2273] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:40:29.954790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:29.964592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9281455-1a8d-40c4-b7ed-69e1f993f46b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:29.969258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:29.969924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:29.970203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:29.970506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:29.971421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:29.973182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd383-666b-4886-abfb-eb1dac79ca2b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:29.986890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1134/2274] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:29.988306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.000896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b035-df20-4afb-87da-58b44bb79374 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.004700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.006706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.006706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.006706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] PATH_INFO: `/v3/projects/c16bd849b7d9456c9d21d29ad24f123b/users/1440a357d5d6444a8cfa37d15c0cdb15/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.027557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16bd849b7d9456c9d21d29ad24f123b, user_id=1440a357d5d6444a8cfa37d15c0cdb15, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.030868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.068504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1141/2275] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:29 2022] PUT /identity/v3/projects/c16bd849b7d9456c9d21d29ad24f123b/users/1440a357d5d6444a8cfa37d15c0cdb15/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:30.084441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.084756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.085085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.126421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] MFA Rules not processed for user `1440a357d5d6444a8cfa37d15c0cdb15`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:30.128188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:30.232335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1135/2276] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:30.236887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.307513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d8994-4b5e-4cb1-98ed-4aad58d24b88 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.313684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.314573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.314889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.315788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.316554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.319338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.356407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1142/2277] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:30 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:30.361296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.380920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f97f-3392-400f-bf1c-34557a8d8edf None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.492351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.493038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.494688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.495290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.496031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.498012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.524671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1136/2278] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:30 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:30.529883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.548067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ace1-24d0-4b15-85a0-cd347feeb475 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.555888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.557616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.558096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.558928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.561758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.564562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.593309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1143/2279] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:40:30.597685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.609123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14800e-c758-4e2b-8a01-bd638b284c81 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.614806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.616190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.616190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.616557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] PATH_INFO: `/v3/projects/9a621183a6f04fba854d928dc34b5f97/users/8b73a9b9227747c29a23312fc31be918/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.637774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a621183a6f04fba854d928dc34b5f97, user_id=8b73a9b9227747c29a23312fc31be918, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.644181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.661919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1137/2280] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:30 2022] PUT /identity/v3/projects/9a621183a6f04fba854d928dc34b5f97/users/8b73a9b9227747c29a23312fc31be918/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:30.667224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.679645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ceccc-2c1c-4f30-9d19-567e52915380 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.751668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.752368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.752628 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.752920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.753680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.755335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50d7f4-5ce1-4036-8db0-4ee9a03d2765 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.769755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1144/2281] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:30.771725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.783400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092cdb-89f0-4bb1-aede-97f918042c0f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:30.789276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:30.790283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.790559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.790857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] PATH_INFO: `/v3/projects/9a621183a6f04fba854d928dc34b5f97/users/8b73a9b9227747c29a23312fc31be918/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.792893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a621183a6f04fba854d928dc34b5f97, user_id=8b73a9b9227747c29a23312fc31be918, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:30.795597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:30.807908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1138/2282] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:30 2022] PUT /identity/v3/projects/9a621183a6f04fba854d928dc34b5f97/users/8b73a9b9227747c29a23312fc31be918/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:30.822739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:30.823135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:30.823652 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:30.854771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] MFA Rules not processed for user `8b73a9b9227747c29a23312fc31be918`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:30.856190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:30.932897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1145/2283] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:30.945465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:30.950378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:31.020985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5983b-cbb7-47cb-a2a7-5a4d0b05275d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:31.024974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:31.025771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:31.026168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:31.026537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:31.036983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:31.039007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a87be-ad5f-42c6-b01a-a57b6f5c806e service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:31.052485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1139/2284] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:31.217054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:31.282756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e95887-4471-446b-ae54-97dc72041306 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:31.288841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:31.290128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:31.290406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:31.291040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] PATH_INFO: `/v3/users/1440a357d5d6444a8cfa37d15c0cdb15` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:31.291973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1440a357d5d6444a8cfa37d15c0cdb15)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:31.294415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:31.356822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1440a357d5d6444a8cfa37d15c0cdb15'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:31.366872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1440a357d5d6444a8cfa37d15c0cdb15'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:31.368580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1440a357d5d6444a8cfa37d15c0cdb15'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:31.376959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1440a357d5d6444a8cfa37d15c0cdb15'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:31.388847 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1440a357d5d6444a8cfa37d15c0cdb15'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:31.395103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1146/2285] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:31 2022] DELETE /identity/v3/users/1440a357d5d6444a8cfa37d15c0cdb15 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:31.399715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:31.400050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:31.400360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:31.418332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:31.419673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:31.487354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1140/2286] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:31.498874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:31.502447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:31.568070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ea0-6463-4136-9906-864430bc9a6e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:31.573131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:31.574039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:31.574605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:31.575085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:31.585373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:31.587108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:31.600627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1147/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:32.201137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:32.204100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:32.221028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee6b12-547c-4ace-8291-1b053af00274 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:32.227142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:32.229167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:32.229396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:32.229817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] PATH_INFO: `/v3/projects/c16bd849b7d9456c9d21d29ad24f123b` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:32.231812 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16bd849b7d9456c9d21d29ad24f123b)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:32.235112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:32.364770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16bd849b7d9456c9d21d29ad24f123b', 'request_id': 'req-6ae517af-8a12-44ee-a553-091fb43697b9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.382257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16bd849b7d9456c9d21d29ad24f123b', 'request_id': 'req-6ae517af-8a12-44ee-a553-091fb43697b9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.400589 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16bd849b7d9456c9d21d29ad24f123b', 'request_id': 'req-6ae517af-8a12-44ee-a553-091fb43697b9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.432511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] The token cache is being invalidate because project c16bd849b7d9456c9d21d29ad24f123b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:32.434011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.436222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.438693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1141/2288] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:32 2022] DELETE /identity/v3/projects/c16bd849b7d9456c9d21d29ad24f123b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:32.442764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:32.462878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce6b8f-c47f-429f-80f7-500568cf2eca service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:32.555213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:32.556348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:32.557284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:32.558010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] PATH_INFO: `/v3/users/8b73a9b9227747c29a23312fc31be918` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:32.559503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b73a9b9227747c29a23312fc31be918)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:32.561834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:32.635587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b73a9b9227747c29a23312fc31be918'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.653306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b73a9b9227747c29a23312fc31be918'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.655100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b73a9b9227747c29a23312fc31be918'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.669900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b73a9b9227747c29a23312fc31be918'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.692303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f2e8bda9-ace5-47fc-9e0b-c62eb89ae5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b73a9b9227747c29a23312fc31be918'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:32.702603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1148/2289] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:32 2022] DELETE /identity/v3/users/8b73a9b9227747c29a23312fc31be918 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:33.163705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:33.165350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:33.189173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae517af-8a12-44ee-a553-091fb43697b9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:33.388380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:33.390114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:33.390608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:33.391142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] PATH_INFO: `/v3/projects/9a621183a6f04fba854d928dc34b5f97` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:33.392808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a621183a6f04fba854d928dc34b5f97)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:33.395097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:33.522329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a621183a6f04fba854d928dc34b5f97', 'request_id': 'req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:33.534420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a621183a6f04fba854d928dc34b5f97', 'request_id': 'req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:33.552922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a621183a6f04fba854d928dc34b5f97', 'request_id': 'req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:33.592236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] The token cache is being invalidate because project 9a621183a6f04fba854d928dc34b5f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:33.592528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:33.593370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-89e2a40a-ce74-4e0e-adb0-58513bcfe75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:33.595548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1142/2290] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:33 2022] DELETE /identity/v3/projects/9a621183a6f04fba854d928dc34b5f97 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:33.600996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:33.601346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:33.601722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:33.640300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:33.642820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:33.727971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1149/2291] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:33.736679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:33.737106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:33.737475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:33.777733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:33.781306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:33.808988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1143/2292] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:33.812786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:33.824941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1e4eb-c355-4b0d-a170-d99775ccc557 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:33.841747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:33.843777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:33.844212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:33.844639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:33.846048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:33.847509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:33.852363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:33.881531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1150/2293] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:33.885692 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:33.896426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4a5e-8288-4a58-8a20-571e8271be88 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:33.904679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:33.905375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:33.905690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:33.905943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:33.906846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:33.910844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:33.959675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1144/2294] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:33 2022] POST /identity/v3/projects => generated 357 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:33.963794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:33.977513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b510ec-3d73-4909-8f21-63a694a65f39 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:34.163075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:34.164339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.164719 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.165346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.166173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:34.168298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:34.236776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1151/2295] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:33 2022] POST /identity/v3/users => generated 279 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:34.237941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:34.257618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1843a-c5b7-420f-96da-5671ef7b044b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:34.267420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:34.268375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.268831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.269247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.270160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:34.277760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:34.293557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1145/2296] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:40:34.298044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:34.311666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0550b0d-a86a-4423-8aad-c59881c340ca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:34.325848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:34.326549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.326901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.327145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.328095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:34.330412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef9c6e-7608-4861-b43d-1abc2281313a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:34.362049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1152/2297] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:34.363318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:34.379949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673fac4-97d0-4a7a-b0a5-43c9248f6411 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:34.389763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:34.391404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.391833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.392331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] PATH_INFO: `/v3/projects/b497792accfd451796e73a63b77b5461/users/f3ab7018778b4b44a6534df1b9644d56/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.438522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b497792accfd451796e73a63b77b5461, user_id=f3ab7018778b4b44a6534df1b9644d56, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:34.441908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:34.481499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1146/2298] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:34 2022] PUT /identity/v3/projects/b497792accfd451796e73a63b77b5461/users/f3ab7018778b4b44a6534df1b9644d56/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:34.496433 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.496798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.497006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.540927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] MFA Rules not processed for user `f3ab7018778b4b44a6534df1b9644d56`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:34.542589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:34.631403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1153/2299] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:34.635592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:34.747604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34deb8-94e0-499c-8871-a20146dfc675 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:34.767590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:34.779162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:34.779489 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:34.779985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:34.780908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:34.783032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:34.835622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1147/2300] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:34 2022] POST /identity/v3/projects => generated 355 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:34.860964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:34.879291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e5094-900b-4b2b-a848-3bef2082eca4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.026481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.027215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.027501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.027785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.028657 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.030630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.074621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1154/2301] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:34 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:35.076290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.088291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890493a-40b3-41f8-8b4e-de896051bc7d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.093497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.094143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.094542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.094933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.095780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.100244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.117154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1148/2302] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:35.122179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.139167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2161-4e95-4a7c-b1a1-576ac2613046 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.149806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.150970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.151254 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.152502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] PATH_INFO: `/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b/users/e15023b4deda4b23984a5b6c4318973f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.185422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309f0f1da3b7453ba4e76fe0015ff12b, user_id=e15023b4deda4b23984a5b6c4318973f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.188780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.233176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1155/2303] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:35 2022] PUT /identity/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b/users/e15023b4deda4b23984a5b6c4318973f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:35.237163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.248934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b551e-4a19-443f-b6c9-21d94b106f89 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.310759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.311480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.311799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.312115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.312918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.315701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9356b7-9e48-4e94-bf8f-26b6cfb3d72e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.331615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.346953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1149/2304] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:35.354716 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf890-0c7a-4e6b-bb94-20c3f47ff9c9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.360810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.371325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.371704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.372741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] PATH_INFO: `/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b/users/e15023b4deda4b23984a5b6c4318973f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.380863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] RBAC: Authorizing `identity:create_grant(project_id=309f0f1da3b7453ba4e76fe0015ff12b, user_id=e15023b4deda4b23984a5b6c4318973f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.384897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f20b32-38b1-4e52-8403-5bab8bc1412d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.404109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1156/2305] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:35 2022] PUT /identity/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b/users/e15023b4deda4b23984a5b6c4318973f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:35.415066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.416002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.418075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.424772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.425417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.425678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.466981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] MFA Rules not processed for user `9c2cfa9e6fb148b49facd7c2c67ebd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:35.467724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] MFA Rules not processed for user `e15023b4deda4b23984a5b6c4318973f`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:35.468424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.471184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.578703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1157/2306] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:35.595471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.599257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1150/2307] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:35.603674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.615076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.618218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.677341 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35c7c-eb93-44ff-88d9-348af0bfee52 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.682590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.683305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.683619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.684081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.699035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.700572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.711754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4225-07be-4246-a2fa-46900d3cd563 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.712753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1158/2308] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:35.716935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.717882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.718166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.718470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.721017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.793849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.795847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0308-354b-4171-8274-80b8c86def4b service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.796660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:35.798194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:35.809957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1151/2309] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:35.818465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a013-d090-44d4-b09c-5bd6650612a1 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:35.826893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:35.827759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.828056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.828336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.903056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:35.904640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:35.914377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1159/2310] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:40:35.921678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b649-d6d1-4cc9-ba06-372e38efb8ff None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:35.921972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b649-d6d1-4cc9-ba06-372e38efb8ff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:35.922315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48b649-d6d1-4cc9-ba06-372e38efb8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:35.940359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1a48b649-d6d1-4cc9-ba06-372e38efb8ff None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:35.941726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1a48b649-d6d1-4cc9-ba06-372e38efb8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:36.020713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1152/2311] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:36.058938 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:36.060766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:36.144143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2b1ad-3144-42c7-9b1c-b8c73cbeef31 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:36.152658 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:36.153333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:36.153613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:36.153893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:36.162945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:36.164671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:36.173503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1160/2312] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:40:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 10 03:40:45.665962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e6e5-9db0-492c-8626-3589a56eb848 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:45.666547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e6e5-9db0-492c-8626-3589a56eb848 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:45.666547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e6e5-9db0-492c-8626-3589a56eb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:45.685718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-65e2e6e5-9db0-492c-8626-3589a56eb848 None None] MFA Rules not processed for user `3117cb6d65454365be315814d9d696cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:45.687013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-65e2e6e5-9db0-492c-8626-3589a56eb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:45.694823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1153/2313] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:46.905467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:46.907123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:47.005004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fde7-e4e2-487f-b11a-509467ee4f37 service swift] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:47.010387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:47.011060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:47.011357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:47.011635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:47.013584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:47.025052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:47.026703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:47.036378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1161/2314] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:48.346581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:48.347118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:48.347118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:48.373792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:48.375296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:48.385153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1154/2315] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:48.400741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:48.414721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f57fb8-11ee-43bc-8e64-18f3425bbdac service placement] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:48.420447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:48.421578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:48.422070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:48.422695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:48.434900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:48.436997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572803-dd04-4917-95f1-211bff61c8e8 service swift] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:48.450512 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1162/2316] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:40:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:51.513783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:51.583624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebf452-e408-40cf-a9f4-1ee910093536 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:51.588074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:51.588964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:51.589243 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:51.589513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] PATH_INFO: `/v3/users/f3ab7018778b4b44a6534df1b9644d56` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:51.590740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ab7018778b4b44a6534df1b9644d56)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:51.592684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:51.641593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ab7018778b4b44a6534df1b9644d56'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:51.649053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ab7018778b4b44a6534df1b9644d56'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:51.660517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ab7018778b4b44a6534df1b9644d56'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:51.661459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ab7018778b4b44a6534df1b9644d56'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:51.672491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ab7018778b4b44a6534df1b9644d56'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:51.679246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1155/2317] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:51 2022] DELETE /identity/v3/users/f3ab7018778b4b44a6534df1b9644d56 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:51.684469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:51.685532 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:51.685944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:51.704791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:51.706434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:51.772624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1163/2318] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:51.782351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:51.783922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:51.852475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219824f-aeb8-421a-9f5d-f655cebb8310 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:51.856165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:51.856813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:51.857094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:51.857366 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:51.867338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:51.868799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:51.882307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1156/2319] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:52.268667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:52.270298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:52.282720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f90cf-11f5-4d86-98c5-d52389c3b83e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:52.287437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:52.288320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:52.288599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:52.288871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] PATH_INFO: `/v3/projects/b497792accfd451796e73a63b77b5461` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:52.290203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b497792accfd451796e73a63b77b5461)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:52.292153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:52.349374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b497792accfd451796e73a63b77b5461', 'request_id': 'req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.354864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b497792accfd451796e73a63b77b5461', 'request_id': 'req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.364269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b497792accfd451796e73a63b77b5461', 'request_id': 'req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.377419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] The token cache is being invalidate because project b497792accfd451796e73a63b77b5461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:52.378120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.378996 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.380570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1164/2320] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:52 2022] DELETE /identity/v3/projects/b497792accfd451796e73a63b77b5461 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:52.386053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:52.398610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd9aa2-b1bb-4e62-b918-e45ab6ea4625 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:52.500721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:52.501642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:52.501925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:52.502198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] PATH_INFO: `/v3/users/e15023b4deda4b23984a5b6c4318973f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:52.506575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15023b4deda4b23984a5b6c4318973f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:52.508725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:52.573123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15023b4deda4b23984a5b6c4318973f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.580472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15023b4deda4b23984a5b6c4318973f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.596230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15023b4deda4b23984a5b6c4318973f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.597621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15023b4deda4b23984a5b6c4318973f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.613527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-844d14d5-2706-4f34-ab1e-9fbea3caa681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15023b4deda4b23984a5b6c4318973f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:52.623090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1157/2321] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:52 2022] DELETE /identity/v3/users/e15023b4deda4b23984a5b6c4318973f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:52.945684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:52.947773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:52.975714 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd24e4-7cc5-478a-89c5-e2aeeba7cb31 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.042058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.043276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.043989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.043989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] PATH_INFO: `/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.045084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309f0f1da3b7453ba4e76fe0015ff12b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.047228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.101389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309f0f1da3b7453ba4e76fe0015ff12b', 'request_id': 'req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:53.107214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309f0f1da3b7453ba4e76fe0015ff12b', 'request_id': 'req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:53.117839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309f0f1da3b7453ba4e76fe0015ff12b', 'request_id': 'req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:53.130310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] The token cache is being invalidate because project 309f0f1da3b7453ba4e76fe0015ff12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:53.130624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:53.131290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c7709dc8-52d4-4e7e-83e6-ab7d6cdcb376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:53.132841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1165/2322] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:52 2022] DELETE /identity/v3/projects/309f0f1da3b7453ba4e76fe0015ff12b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:53.137877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.138105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.138379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.156706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:53.158308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:53.237545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1158/2323] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:53.247010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.247653 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.248311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.277282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:53.278545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:53.296354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1166/2324] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:40:53.300312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.316454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66ecb-2db9-4163-81db-bfd88c2790cc None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.321789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.322606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.323022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.323386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.325254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:53.325656 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.327428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.341380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1159/2325] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:53.345520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.359931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c862ff1-0823-4ca5-9755-300bfc52091e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.365214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.365884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.366168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.366446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.367206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.369158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.411241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1167/2326] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:53.412394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.423412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf2f7-1461-4c24-adcf-a46a506f4a67 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.479957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.481299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.481585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.481863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.482592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.485359 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.510700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1160/2327] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:53.514362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.525380 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb6259-6295-4adc-bdb5-f8635d8b3d7c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.533174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.533986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.534349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.534679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.535486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.537116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.548815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1168/2328] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:53.553442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.573005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6c67-90c6-4cfa-9776-5b7873c2aa6d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.579641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.581439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.582006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.582394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.583302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.585018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ff646-a604-4dbf-af46-d00ea43b5c4c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.599774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1161/2329] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:53.600993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.611675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0518b-0dbb-453d-9e52-ec58577a2c6c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.616485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.617385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.617659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.617932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] PATH_INFO: `/v3/projects/30772912a16249fb84183a1fbc4f01ea/users/786e62d1db5f4e42be2d494bdf9c480b/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.633864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=30772912a16249fb84183a1fbc4f01ea, user_id=786e62d1db5f4e42be2d494bdf9c480b, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.636786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.661426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1169/2330] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:53 2022] PUT /identity/v3/projects/30772912a16249fb84183a1fbc4f01ea/users/786e62d1db5f4e42be2d494bdf9c480b/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:53.668675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.668953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.669253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.707777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] MFA Rules not processed for user `786e62d1db5f4e42be2d494bdf9c480b`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:53.709147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:53.794623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1162/2331] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:53.798932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.866901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f87-3c4f-4de8-8dc7-bb5a90005bcf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.872163 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.872838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.873118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.873392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.874102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.876088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:53.914242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1170/2332] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:53.923859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:53.929257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a652-436d-4c77-afb2-5deade5c75f7 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:53.986887 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:53.987688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:53.987963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:53.988232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:53.988941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:53.990908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.016285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1163/2333] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:53 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:54.017498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.028466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35013-90c1-4f1b-9ab2-19b048cc7811 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.033111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.033781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.034061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.034370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.035138 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.036752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.047808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1171/2334] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:40:54.052929 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.063290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa36c-c7d1-4b47-a3ab-e9541a456380 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.067879 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.068760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.069143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.069457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] PATH_INFO: `/v3/projects/a6c992f018b245f5afbc25b9f5b5304c/users/cd0238ad3142430c9d4ca7b9073c7ddc/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.085022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c992f018b245f5afbc25b9f5b5304c, user_id=cd0238ad3142430c9d4ca7b9073c7ddc, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.088270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.112007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1164/2335] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:54 2022] PUT /identity/v3/projects/a6c992f018b245f5afbc25b9f5b5304c/users/cd0238ad3142430c9d4ca7b9073c7ddc/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:54.118772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.130677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba071-ee92-4f6e-a559-8de1b1ff7903 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.201308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.201910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.202717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.203259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.204199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.205887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303eeb3-6c47-4a0d-9a21-ddc3cab0299b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.219644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1172/2336] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:54.221010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.231873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1aaf-e040-4e66-8c74-21a9f898dd9b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.236563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.237506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.237782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.238049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] PATH_INFO: `/v3/projects/a6c992f018b245f5afbc25b9f5b5304c/users/cd0238ad3142430c9d4ca7b9073c7ddc/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.240140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c992f018b245f5afbc25b9f5b5304c, user_id=cd0238ad3142430c9d4ca7b9073c7ddc, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.242897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.253788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1165/2337] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:54 2022] PUT /identity/v3/projects/a6c992f018b245f5afbc25b9f5b5304c/users/cd0238ad3142430c9d4ca7b9073c7ddc/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:54.264117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.264405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.264681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.294267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] MFA Rules not processed for user `cd0238ad3142430c9d4ca7b9073c7ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:54.295618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:54.363411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1173/2338] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:54.379332 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.381186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:54.504421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d69ec-8453-474f-b459-3e8f7ef6d77d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.508143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.508797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.509116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.509344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.522043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.526842 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.537162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1166/2339] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:54.859749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.877071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b7db7-0781-4009-b75d-07827cc5015c None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.882343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0238ad3142430c9d4ca7b9073c7ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6c992f018b245f5afbc25b9f5b5304c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.883387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.883837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.884210 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.885229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:54.885631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.887487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.909071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1174/2340] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:40:54.913239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.923002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cefc9-47f7-4807-b363-8e8dee014023 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:54.928514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0238ad3142430c9d4ca7b9073c7ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6c992f018b245f5afbc25b9f5b5304c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:54.929436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:54.929856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:54.930185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:54.931004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:54.932986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:54.978115 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1167/2341] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:54 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:54.982695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:54.992766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a93ad2-4f66-4d2c-82bc-e37ad307bd50 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:55.104372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0238ad3142430c9d4ca7b9073c7ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6c992f018b245f5afbc25b9f5b5304c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:55.105101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:55.105339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:55.105619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:55.106374 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:55.106717 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:55.108396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:55.125125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1175/2342] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:55.171104 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:55.185735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feb293-7038-4de0-a2c7-67bd874ac8fb tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:55.191334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0238ad3142430c9d4ca7b9073c7ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6c992f018b245f5afbc25b9f5b5304c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:55.192351 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:55.192707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:55.192989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] PATH_INFO: `/v3/projects/f2fc186297c14ca7ae10de5222cfbbe6` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:55.194204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2fc186297c14ca7ae10de5222cfbbe6)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:55.196217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:55.245555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fc186297c14ca7ae10de5222cfbbe6', 'request_id': 'req-6dd9fdbe-872b-48f4-b346-ef030875d750'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.250817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fc186297c14ca7ae10de5222cfbbe6', 'request_id': 'req-6dd9fdbe-872b-48f4-b346-ef030875d750'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.262871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fc186297c14ca7ae10de5222cfbbe6', 'request_id': 'req-6dd9fdbe-872b-48f4-b346-ef030875d750'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.275301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] The token cache is being invalidate because project f2fc186297c14ca7ae10de5222cfbbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:55.275839 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.276945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-6dd9fdbe-872b-48f4-b346-ef030875d750 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.278836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1168/2343] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:55 2022] DELETE /identity/v3/projects/f2fc186297c14ca7ae10de5222cfbbe6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:55.477023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:55.478901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:55.549096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b78c0-d089-48cf-be4a-3e5f35409a56 tempest-VolumeQuotaClassesTest-150892224 tempest-VolumeQuotaClassesTest-150892224-project-admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:55.609900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:55.610958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:55.611372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:55.611704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] PATH_INFO: `/v3/users/786e62d1db5f4e42be2d494bdf9c480b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:55.613359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=786e62d1db5f4e42be2d494bdf9c480b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:55.615636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:55.679929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786e62d1db5f4e42be2d494bdf9c480b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.692824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786e62d1db5f4e42be2d494bdf9c480b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.704137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786e62d1db5f4e42be2d494bdf9c480b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.727179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786e62d1db5f4e42be2d494bdf9c480b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.742083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786e62d1db5f4e42be2d494bdf9c480b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:55.749347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1176/2344] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:55 2022] DELETE /identity/v3/users/786e62d1db5f4e42be2d494bdf9c480b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:55.753818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:55.754102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:55.754371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:55.779927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:55.781165 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:55.857131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1169/2345] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:55.867619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:55.869146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:55.932852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e431d-5ee7-4dc4-ae58-6bb667af7af1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:55.936414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:55.937071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:55.937366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:55.937646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:55.950542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:55.952064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:55.963448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1177/2346] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:40:56.354540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:56.356049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:56.368937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9651e7-eedd-4c8d-97fe-3133053c00d0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:56.374440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:56.375571 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:56.376616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:56.377154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] PATH_INFO: `/v3/projects/30772912a16249fb84183a1fbc4f01ea` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:56.378794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30772912a16249fb84183a1fbc4f01ea)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:56.381277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:56.449141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30772912a16249fb84183a1fbc4f01ea', 'request_id': 'req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.455832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30772912a16249fb84183a1fbc4f01ea', 'request_id': 'req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.499048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30772912a16249fb84183a1fbc4f01ea', 'request_id': 'req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.572872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] The token cache is being invalidate because project 30772912a16249fb84183a1fbc4f01ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:56.575173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.578849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.581766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1170/2347] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:56 2022] DELETE /identity/v3/projects/30772912a16249fb84183a1fbc4f01ea => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:56.586240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:56.604355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2fe16-a600-48a1-b8e4-9302e46d71ff service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:56.676413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:56.677365 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:56.677649 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:56.677987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] PATH_INFO: `/v3/users/cd0238ad3142430c9d4ca7b9073c7ddc` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:56.679233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0238ad3142430c9d4ca7b9073c7ddc)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:56.681240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:56.738948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0238ad3142430c9d4ca7b9073c7ddc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.747824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0238ad3142430c9d4ca7b9073c7ddc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.748566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0238ad3142430c9d4ca7b9073c7ddc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.761781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0238ad3142430c9d4ca7b9073c7ddc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.774132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-752af2c3-c523-494c-909e-a7c105be6a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0238ad3142430c9d4ca7b9073c7ddc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:56.780930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1178/2348] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:40:56 2022] DELETE /identity/v3/users/cd0238ad3142430c9d4ca7b9073c7ddc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:57.142876 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.144875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:57.161418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f473e-22f6-4ec7-a0e1-1fbc6f2b6c57 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.223748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.224628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.224902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.225172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] PATH_INFO: `/v3/projects/a6c992f018b245f5afbc25b9f5b5304c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.226382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c992f018b245f5afbc25b9f5b5304c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.228324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.278247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c992f018b245f5afbc25b9f5b5304c', 'request_id': 'req-09e00a68-4f33-4535-ad82-9c21dfaba09f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:57.285310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c992f018b245f5afbc25b9f5b5304c', 'request_id': 'req-09e00a68-4f33-4535-ad82-9c21dfaba09f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:57.293939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c992f018b245f5afbc25b9f5b5304c', 'request_id': 'req-09e00a68-4f33-4535-ad82-9c21dfaba09f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:57.306136 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] The token cache is being invalidate because project a6c992f018b245f5afbc25b9f5b5304c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:40:57.306466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:57.307093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-09e00a68-4f33-4535-ad82-9c21dfaba09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:40:57.308845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1171/2349] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:40:57 2022] DELETE /identity/v3/projects/a6c992f018b245f5afbc25b9f5b5304c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:57.314445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.314837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.315183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.334165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:57.335421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:57.395040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1179/2350] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:57.402993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.403549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.403743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.423027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:57.424302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:57.433371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1172/2351] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:57.437420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.447622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5ea7f-b73b-4054-83bd-e93cfc4e38f9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.452888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.453555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.453837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.454110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.454960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:40:57.455271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.456927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.468872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1180/2352] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:40:57.473171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.482604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434aa5b-20b4-4379-a65e-7973cf02736a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.487266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.487997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.488333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.488663 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.489435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.491420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.519681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1173/2353] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:57.524133 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.538768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7297b-ba13-4b58-9136-7c121762f4a4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.600682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.601482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.601832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.602219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.603004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.604995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.626475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1181/2354] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:57.630744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.641564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a293-cf5a-443e-bc67-f73178734db7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.647392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.648066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.648346 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.648614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.649380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.651037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.661722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1174/2355] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:57.666065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.677515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40125c5b-b40b-4002-b46e-61c465bfb126 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.691412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.692123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.692363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.692667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.693576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.695671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620067dd-5c4c-4606-a07e-95173426bd7a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.706241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1182/2356] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:57.710568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.721344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6c802-780b-402f-ba58-0885c9eef168 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.727341 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.728228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.728511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.728776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] PATH_INFO: `/v3/projects/7982ce105abd436f8719a30649156e9e/users/322b2c206b0c40cda387893ce79b2801/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.745969 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7982ce105abd436f8719a30649156e9e, user_id=322b2c206b0c40cda387893ce79b2801, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.748830 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.764109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1175/2357] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:57 2022] PUT /identity/v3/projects/7982ce105abd436f8719a30649156e9e/users/322b2c206b0c40cda387893ce79b2801/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:57.775642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.775932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.776389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.803584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] MFA Rules not processed for user `322b2c206b0c40cda387893ce79b2801`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:57.804796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:57.879146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1183/2358] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:57.883743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.942984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36efde-a036-485c-9700-a9f92a87daf5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:57.947920 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:57.948573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:57.948862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:57.949131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:57.949821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:57.951762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:57.979474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1176/2359] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:40:57.984021 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:57.995471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a22238-7bce-439e-8a5a-d016a22dcdcd None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.053415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.054097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.054378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.055089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.055794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.057752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.083570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1184/2360] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:40:57 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:40:58.087394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:58.098391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4abec-4ed3-4529-a178-d4cfaf1b79c7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.104080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.105113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.105490 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.105856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.106777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.108422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.128509 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:58.136395 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1177/2361] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:58.140218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b481fa-ee05-4ccd-b630-c0e6f8279107 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.147983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.148918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.149201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.149493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] PATH_INFO: `/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184/users/e6b63217ab9442048eedf6bbc966c3b2/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.178437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e73f7b9ebdf40298b10ee7ec6276184, user_id=e6b63217ab9442048eedf6bbc966c3b2, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.181861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.200091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1185/2362] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:58 2022] PUT /identity/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184/users/e6b63217ab9442048eedf6bbc966c3b2/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:40:58.204169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:58.216554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104ba90-f7ff-4c73-bc61-65b46cd9d670 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.283650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.284609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.284917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.285149 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.285899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.287541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12923-e91d-4573-b3f6-e317cba71ed1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.298353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1178/2363] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:40:58.302632 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:58.314090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53761c81-e0c6-4b87-a7aa-b3a3ac380e2f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.336869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.337796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.338078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.338409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] PATH_INFO: `/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184/users/e6b63217ab9442048eedf6bbc966c3b2/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.341743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e73f7b9ebdf40298b10ee7ec6276184, user_id=e6b63217ab9442048eedf6bbc966c3b2, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.346476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.367564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1186/2364] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:40:58 2022] PUT /identity/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184/users/e6b63217ab9442048eedf6bbc966c3b2/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:40:58.378403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.378998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.379298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.410645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] MFA Rules not processed for user `e6b63217ab9442048eedf6bbc966c3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:40:58.413025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:58.491581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1179/2365] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:40:58.501920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:40:58.503802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:40:58.588461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dc937-e1d2-460d-85ec-eb7c7fe32303 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:40:58.592640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:40:58.593304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:40:58.593682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:40:58.594008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:40:58.660147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:40:58.662476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:40:58.674838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1187/2366] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:02.860190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:02.861583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:02.884027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec54c-7955-458c-8b71-ed948c478d1c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:02.889172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:02.889676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:02.889957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:02.890246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:02.901316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:02.902792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c395d4-15ce-4f00-b624-822d8d6c1f34 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:02.925216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1180/2367] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:07.790159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:07.854112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611b59a-2e5d-47d7-98e5-e23be3a2228d service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:07.858684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:07.859584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:07.859865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:07.860137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] PATH_INFO: `/v3/users/322b2c206b0c40cda387893ce79b2801` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:07.861330 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322b2c206b0c40cda387893ce79b2801)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:07.863263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:07.911933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322b2c206b0c40cda387893ce79b2801'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:07.924084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322b2c206b0c40cda387893ce79b2801'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:07.924723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322b2c206b0c40cda387893ce79b2801'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:07.932052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322b2c206b0c40cda387893ce79b2801'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:07.944438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322b2c206b0c40cda387893ce79b2801'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:07.951515 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1188/2368] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:07 2022] DELETE /identity/v3/users/322b2c206b0c40cda387893ce79b2801 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:07.956693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:07.957336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:07.957336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:07.977007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:07.978118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:08.040848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1181/2369] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:08.051289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:08.052707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:08.113763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70eb2b-9ba4-4a47-8f58-dedd3eccd5d3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:08.117383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:08.118062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:08.118345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:08.118638 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:08.128258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:08.129698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:08.141323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1189/2370] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:08.401761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:08.403337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:08.416110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7670da-c372-49eb-9ca9-65626c4302e3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:08.425521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:08.427672 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:08.427971 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:08.428277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] PATH_INFO: `/v3/projects/7982ce105abd436f8719a30649156e9e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:08.432610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7982ce105abd436f8719a30649156e9e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:08.434594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:08.480609 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7982ce105abd436f8719a30649156e9e', 'request_id': 'req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.485852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7982ce105abd436f8719a30649156e9e', 'request_id': 'req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.493545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7982ce105abd436f8719a30649156e9e', 'request_id': 'req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.505915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] The token cache is being invalidate because project 7982ce105abd436f8719a30649156e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:08.506070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.506755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.508250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1182/2371] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:08 2022] DELETE /identity/v3/projects/7982ce105abd436f8719a30649156e9e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:08.512397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:08.521994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3b4a3-ec5c-4bea-a416-3eb75595d869 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:08.582272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:08.583184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:08.583459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:08.583729 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] PATH_INFO: `/v3/users/e6b63217ab9442048eedf6bbc966c3b2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:08.585135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b63217ab9442048eedf6bbc966c3b2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:08.587256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:08.642359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b63217ab9442048eedf6bbc966c3b2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.651282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b63217ab9442048eedf6bbc966c3b2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.651927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b63217ab9442048eedf6bbc966c3b2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.659022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b63217ab9442048eedf6bbc966c3b2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.672328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d9f3e61a-10c4-444d-8cc5-31a6c82f1e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b63217ab9442048eedf6bbc966c3b2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:08.678882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1190/2372] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:08 2022] DELETE /identity/v3/users/e6b63217ab9442048eedf6bbc966c3b2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:41:09.033445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.034924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:09.048043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea913f-9476-4c5f-b811-7e5f6aa3eaf8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.103062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.104132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.104291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.104585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] PATH_INFO: `/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.105995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e73f7b9ebdf40298b10ee7ec6276184)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.107924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.158372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e73f7b9ebdf40298b10ee7ec6276184', 'request_id': 'req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:09.163834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e73f7b9ebdf40298b10ee7ec6276184', 'request_id': 'req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:09.172654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e73f7b9ebdf40298b10ee7ec6276184', 'request_id': 'req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:09.183650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] The token cache is being invalidate because project 5e73f7b9ebdf40298b10ee7ec6276184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:09.183934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:09.184565 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2a098e3c-f8cc-461e-a6dd-028d9cf537e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:09.186107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1183/2373] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:09 2022] DELETE /identity/v3/projects/5e73f7b9ebdf40298b10ee7ec6276184 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:09.192226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.192745 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.192850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.210619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:09.211844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:09.270992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1191/2374] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:09.280671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.281072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.281392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.300143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:09.301523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:09.309673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1184/2375] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:41:09.314083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.324135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8381-3794-4dd7-bf60-fe3d42927852 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.329535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.330189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.330490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.330803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.331534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:41:09.331839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.333482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.344978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1192/2376] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:41:09.349499 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.359176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8333086-c6bb-4343-a049-cbbcd49e3749 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.363804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.364459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.364762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.365015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.365751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.367685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.397055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1185/2377] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:41:09.398229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.408858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20feb6-4464-4deb-b25d-88e1b00ab5f8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.466690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.467547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.467814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.468093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.468836 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.470918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.501320 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1193/2378] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:09.503203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.515878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159cd01-ddba-416b-9cf6-106682fb0405 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.521865 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.522628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.523033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.523371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.524188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.526060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.541521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1186/2379] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:09.542309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.553064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6dcbc-7ba6-41a8-8cd0-10ad016996aa admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.558623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.559452 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.559736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.560010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.560916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.562537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7961ec6-acd6-4042-a782-1de2881edd55 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.572971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1194/2380] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:09.577376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.587924 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab47112-e2d0-4f8c-8549-4649ddcf8b13 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.593306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.594260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.594540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.594861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] PATH_INFO: `/v3/projects/aaedf5441ea549a38d83da14a265894e/users/3c885854d0174b3a875dbef58e553bc9/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.610234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaedf5441ea549a38d83da14a265894e, user_id=3c885854d0174b3a875dbef58e553bc9, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.613026 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.627437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1187/2381] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:09 2022] PUT /identity/v3/projects/aaedf5441ea549a38d83da14a265894e/users/3c885854d0174b3a875dbef58e553bc9/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:09.639166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.639616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.639999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.666478 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] MFA Rules not processed for user `3c885854d0174b3a875dbef58e553bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:09.667691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:09.733352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1195/2382] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:09.738174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.808617 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee4ea-1ade-4c7c-9af7-2b5ea1addd53 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.813561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.814204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.814487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.814790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.815498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.817397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.845905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1188/2383] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:09.851595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.863893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dce82-e16c-4a73-a596-ca873e7ec5a3 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.925099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.925781 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.930582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.930582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.930582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.930582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.951481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1196/2384] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:09 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:09.955592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:09.966150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efce991-5110-4f2a-a8e9-b697affd57f8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:09.971335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:09.971994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:09.972269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:09.972546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:09.973287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:09.974945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:09.986584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1189/2385] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:09.990832 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.002859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1eb8d-432d-4eeb-bac0-1844e797698e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.008527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.009191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.009472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.009742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.010483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.012308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c75b4d-0677-49ae-97fb-c568b60bbf7d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.026333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1197/2386] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:10.027671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.039002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4749-e6e8-448f-91e7-0b8e77916649 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.044566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.045459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.045737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.046029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] PATH_INFO: `/v3/projects/acf6b135be22431d99d4dbdb8da7e0e8/users/67f8aac273c444c18d3c7a5a390cbb2e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.061666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf6b135be22431d99d4dbdb8da7e0e8, user_id=67f8aac273c444c18d3c7a5a390cbb2e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.064962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.082957 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1190/2387] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:10 2022] PUT /identity/v3/projects/acf6b135be22431d99d4dbdb8da7e0e8/users/67f8aac273c444c18d3c7a5a390cbb2e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:10.093571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.093884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.094218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.121743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] MFA Rules not processed for user `67f8aac273c444c18d3c7a5a390cbb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:10.122968 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:10.191267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1198/2388] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:10.193754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.255336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a802-0252-4efc-a568-50e6d60e2d72 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.260054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.260703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.260978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.261264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.261945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.263871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.294496 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1191/2389] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:10 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:10.296119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.308074 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd1e60-6b7f-4eff-9a3b-055e2a91014f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.362242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.362862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.363147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.363421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.364131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.366048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.388215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1199/2390] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:10 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:10.392355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.403277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6e9b-67af-4fad-8237-c3b538f78152 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.408637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.409301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.409582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.409854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.410599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.412259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.423087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1192/2391] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:41:10.427301 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.437377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4bfd-c358-45af-bf4b-77dafb3ed09d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.442492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.443432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.443733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.444010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] PATH_INFO: `/v3/projects/25d0b680e893471a8ef163631d63aa5a/users/7b6dc3353d64463c9e91f72f44a3dc5f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.459031 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d0b680e893471a8ef163631d63aa5a, user_id=7b6dc3353d64463c9e91f72f44a3dc5f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.461696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.476863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1200/2392] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:10 2022] PUT /identity/v3/projects/25d0b680e893471a8ef163631d63aa5a/users/7b6dc3353d64463c9e91f72f44a3dc5f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:10.481073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.490943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce2b5-ce87-469c-93f8-7a7656712b09 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.547229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.547960 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.548169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.548459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.549181 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.550789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea52436-71e7-4a1f-b2d8-a386a7cbe881 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.561061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1193/2393] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:10.565438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.576146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9913f-dcaf-462e-80b1-6891eaf46ed2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.580975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.581861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.582137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.582410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] PATH_INFO: `/v3/projects/25d0b680e893471a8ef163631d63aa5a/users/7b6dc3353d64463c9e91f72f44a3dc5f/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.584425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d0b680e893471a8ef163631d63aa5a, user_id=7b6dc3353d64463c9e91f72f44a3dc5f, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.587097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.597979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1201/2394] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:10 2022] PUT /identity/v3/projects/25d0b680e893471a8ef163631d63aa5a/users/7b6dc3353d64463c9e91f72f44a3dc5f/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:10.609046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.609345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.609618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.636629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] MFA Rules not processed for user `7b6dc3353d64463c9e91f72f44a3dc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:10.637864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:10.707459 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1194/2395] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:10.718082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:10.719961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:10.776589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e5f0b-85e1-4d49-bd21-3c6352b14f5c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:10.780309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:10.780967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:10.781242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:10.781513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:10.836455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:10.837959 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:10.846746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1202/2396] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:12.342474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:12.343989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:12.356933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b830-3353-4138-bdae-38040c8e9353 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:12.360592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:12.361228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:12.361501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:12.361783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:12.422752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:12.424204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:12.433506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1195/2397] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:12.952402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:12.961391 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918240-3b5a-49a4-891c-0b1bc255e74b service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:12.965676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:12.966360 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:12.966615 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:12.966922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:12.976971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:12.978420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:12.988813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1203/2398] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:15.996708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:15.998465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:16.062528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9b5df-97ae-4d3d-9bab-459e65b81cf0 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:16.067352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:16.068121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:16.068468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:16.068746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:16.072086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:16.138376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:16.139855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb864fa-2e52-43b7-b116-bb30fb6d5cbe service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:16.152358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1196/2399] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:17.055179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:17.117408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac820c-1c63-4d1b-8ab8-92e509cc9ffe service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:17.122905 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:17.123733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:17.124015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:17.124307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] PATH_INFO: `/v3/users/3c885854d0174b3a875dbef58e553bc9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:17.125629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c885854d0174b3a875dbef58e553bc9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:17.127695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:17.179110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c885854d0174b3a875dbef58e553bc9'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.186560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c885854d0174b3a875dbef58e553bc9'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.187238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c885854d0174b3a875dbef58e553bc9'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.195259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c885854d0174b3a875dbef58e553bc9'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.208829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c885854d0174b3a875dbef58e553bc9'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.215183 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1204/2400] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:17 2022] DELETE /identity/v3/users/3c885854d0174b3a875dbef58e553bc9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:41:17.219591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:17.220078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:17.220283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:17.237094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:17.238290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:17.298567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1197/2401] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:41:17.308885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:17.310809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:17.373799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dccbf-147a-4f00-8b34-f45c0f1c73b3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:17.379102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:17.380819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:17.381270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:17.381670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:17.392432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:17.393896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:17.404426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1205/2402] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:17.713927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:17.716166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:17.732011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e38faa-526b-45ec-9910-8c2c6f848dee None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:17.738033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:17.739612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:17.739898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:17.740168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] PATH_INFO: `/v3/projects/aaedf5441ea549a38d83da14a265894e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:17.742024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaedf5441ea549a38d83da14a265894e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:17.744217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:17.802568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaedf5441ea549a38d83da14a265894e', 'request_id': 'req-1036ef3e-eb46-4cfa-a216-30757459251b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.810350 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaedf5441ea549a38d83da14a265894e', 'request_id': 'req-1036ef3e-eb46-4cfa-a216-30757459251b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.819180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaedf5441ea549a38d83da14a265894e', 'request_id': 'req-1036ef3e-eb46-4cfa-a216-30757459251b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.831365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] The token cache is being invalidate because project aaedf5441ea549a38d83da14a265894e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:17.831889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.832699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.834721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1198/2403] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:17 2022] DELETE /identity/v3/projects/aaedf5441ea549a38d83da14a265894e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:17.838526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:17.851557 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89cb15-b531-421f-b205-81fffcf2ca9a service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:17.914903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:17.915876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:17.916161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:17.916521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] PATH_INFO: `/v3/users/67f8aac273c444c18d3c7a5a390cbb2e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:17.917755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f8aac273c444c18d3c7a5a390cbb2e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:17.919733 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:17.975099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f8aac273c444c18d3c7a5a390cbb2e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.982728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f8aac273c444c18d3c7a5a390cbb2e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.983390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f8aac273c444c18d3c7a5a390cbb2e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:17.990277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f8aac273c444c18d3c7a5a390cbb2e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.002181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f8aac273c444c18d3c7a5a390cbb2e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.008405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1206/2404] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:17 2022] DELETE /identity/v3/users/67f8aac273c444c18d3c7a5a390cbb2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:18.480320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:18.481852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:18.528271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036ef3e-eb46-4cfa-a216-30757459251b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:18.622399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:18.623669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:18.624090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:18.624514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] PATH_INFO: `/v3/projects/acf6b135be22431d99d4dbdb8da7e0e8` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:18.626057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf6b135be22431d99d4dbdb8da7e0e8)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:18.628314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:18.700338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf6b135be22431d99d4dbdb8da7e0e8', 'request_id': 'req-11a7268d-befc-4179-96f6-f480faff2b99'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.706895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf6b135be22431d99d4dbdb8da7e0e8', 'request_id': 'req-11a7268d-befc-4179-96f6-f480faff2b99'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.724117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf6b135be22431d99d4dbdb8da7e0e8', 'request_id': 'req-11a7268d-befc-4179-96f6-f480faff2b99'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.739782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] The token cache is being invalidate because project acf6b135be22431d99d4dbdb8da7e0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:18.740117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.740780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.745919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1199/2405] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:18 2022] DELETE /identity/v3/projects/acf6b135be22431d99d4dbdb8da7e0e8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:18.747402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:18.749410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:18.765034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707e790-6cde-4e2d-9d93-b95f891aa7f2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:18.831276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:18.832558 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:18.833062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:18.833540 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] PATH_INFO: `/v3/users/7b6dc3353d64463c9e91f72f44a3dc5f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:18.835110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6dc3353d64463c9e91f72f44a3dc5f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:18.837340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:18.906126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6dc3353d64463c9e91f72f44a3dc5f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.918164 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6dc3353d64463c9e91f72f44a3dc5f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.919539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6dc3353d64463c9e91f72f44a3dc5f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.930245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6dc3353d64463c9e91f72f44a3dc5f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.946055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-90c6d981-746c-47db-a3ae-582993bfcd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6dc3353d64463c9e91f72f44a3dc5f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:18.956746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1207/2406] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:18 2022] DELETE /identity/v3/users/7b6dc3353d64463c9e91f72f44a3dc5f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:20.257416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:20.259869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:20.284576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7268d-befc-4179-96f6-f480faff2b99 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:20.392352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:20.393544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.394832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.397306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] PATH_INFO: `/v3/projects/25d0b680e893471a8ef163631d63aa5a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.400336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d0b680e893471a8ef163631d63aa5a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:20.403156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:20.482255 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d0b680e893471a8ef163631d63aa5a', 'request_id': 'req-1d2f695b-2761-4e02-927f-40d77032c0b1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:20.491577 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d0b680e893471a8ef163631d63aa5a', 'request_id': 'req-1d2f695b-2761-4e02-927f-40d77032c0b1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:20.509340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d0b680e893471a8ef163631d63aa5a', 'request_id': 'req-1d2f695b-2761-4e02-927f-40d77032c0b1'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:20.526123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] The token cache is being invalidate because project 25d0b680e893471a8ef163631d63aa5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:20.526852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:20.527913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-1d2f695b-2761-4e02-927f-40d77032c0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:20.534836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1200/2407] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:20 2022] DELETE /identity/v3/projects/25d0b680e893471a8ef163631d63aa5a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:20.535873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.536695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.536978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.557611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:20.559115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:20.632421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1208/2408] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:41:20.640737 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.641262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.641615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.664599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:20.666634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:20.679763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1201/2409] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:20.684152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:20.695891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433e3d-4499-4e61-a5f9-a23de5e0b1a2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:20.704517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:20.705489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.705944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.706485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.707498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:41:20.709610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:20.710334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:20.725408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1209/2410] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:41:20.729624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:20.739980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f81f-440d-4d9a-a626-541630777b5e None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:20.745487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:20.746160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.746612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.746916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.748055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:20.750251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:20.781976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1202/2411] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:20 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:20.786125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:20.798845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c75bc-1ce3-4974-8b02-689cdaa8339f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:20.941121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:20.943396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:20.946722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:20.947310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:20.948369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:20.952437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:21.007618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1210/2412] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:20 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:21.011699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:21.024891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea9e8-da43-4a19-9ca0-ecfe485422da admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:21.046721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:21.047445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:21.047722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:21.047996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:21.051937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:21.053606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:21.100375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1203/2413] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:21.101974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:21.120388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a815-81c2-4cf8-98eb-ed0fbee7dec9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:21.141803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:21.142505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:21.143024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:21.143453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:21.144376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:21.146172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcebbf0-ce3b-4acf-8fc1-fd7c1ac89a54 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:21.174047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:21.179073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1211/2414] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:21.186944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c24b-ae11-4437-9a37-a52ac05357b8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:21.205141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:21.206349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:21.206840 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:21.207259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] PATH_INFO: `/v3/projects/68c1e9bc3200482395fb631f12cf665c/users/6184bf77ac86426fba25059ae0fc0736/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:21.241270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c1e9bc3200482395fb631f12cf665c, user_id=6184bf77ac86426fba25059ae0fc0736, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:21.243984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:21.287065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1204/2415] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:21 2022] PUT /identity/v3/projects/68c1e9bc3200482395fb631f12cf665c/users/6184bf77ac86426fba25059ae0fc0736/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:21.297895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38c2e-377c-4aa1-b498-9ffe46d2179f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:21.298482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38c2e-377c-4aa1-b498-9ffe46d2179f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:21.298955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d38c2e-377c-4aa1-b498-9ffe46d2179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:21.358928 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e3d38c2e-377c-4aa1-b498-9ffe46d2179f None None] MFA Rules not processed for user `6184bf77ac86426fba25059ae0fc0736`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:21.360314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e3d38c2e-377c-4aa1-b498-9ffe46d2179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:21.516053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1212/2416] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:21.528606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:21.530735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:21.661276 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405fa34-5f97-4843-84e3-d2e7f7f11ee6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:21.665325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:21.666987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:21.667278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:21.667554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:21.677966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:21.679837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:21.692309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1205/2417] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:24.380470 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac04c-437c-4f97-8238-240954f18722 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:24.381053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac04c-437c-4f97-8238-240954f18722 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:24.381162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac04c-437c-4f97-8238-240954f18722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:24.401019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-836ac04c-437c-4f97-8238-240954f18722 None None] MFA Rules not processed for user `d637094d14264332b6a947fe1e5c0ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:24.401151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-836ac04c-437c-4f97-8238-240954f18722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:24.403290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:24.464335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1213/2418] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:24.479314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953718-c4f4-4fcd-a323-19d886d95b30 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:24.486793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:24.487701 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:24.487979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:24.488239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] PATH_INFO: `/v3/users/6184bf77ac86426fba25059ae0fc0736` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:24.489487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6184bf77ac86426fba25059ae0fc0736)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:24.491488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:24.553193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6184bf77ac86426fba25059ae0fc0736'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:24.559798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6184bf77ac86426fba25059ae0fc0736'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:24.571232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6184bf77ac86426fba25059ae0fc0736'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:24.571933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6184bf77ac86426fba25059ae0fc0736'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:24.579851 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6184bf77ac86426fba25059ae0fc0736'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:24.586470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1206/2419] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:24 2022] DELETE /identity/v3/users/6184bf77ac86426fba25059ae0fc0736 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:41:24.591142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:24.591707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:24.592022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:24.609403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:24.610702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:24.665783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1214/2420] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:24.675574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:24.676977 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:24.740342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78061-e07c-41b7-9a22-324a36886808 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:24.744600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:24.745288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:24.745570 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:24.745844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:24.756211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:24.757831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:24.767966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1207/2421] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:25.042645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:25.044553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:25.057402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dd0c4-b39f-4900-b5b5-969902296789 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:25.063328 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:25.064285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:25.064661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:25.065096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] PATH_INFO: `/v3/projects/68c1e9bc3200482395fb631f12cf665c` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:25.066356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c1e9bc3200482395fb631f12cf665c)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:25.068293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:25.129361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c1e9bc3200482395fb631f12cf665c', 'request_id': 'req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:25.135498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c1e9bc3200482395fb631f12cf665c', 'request_id': 'req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:25.148139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c1e9bc3200482395fb631f12cf665c', 'request_id': 'req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:25.162099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] The token cache is being invalidate because project 68c1e9bc3200482395fb631f12cf665c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:25.162475 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:25.163157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:25.165439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1215/2422] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:25 2022] DELETE /identity/v3/projects/68c1e9bc3200482395fb631f12cf665c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:37.183526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:37.185425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:37.207106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea28a-704c-4c22-b285-b5dd1de16ddf service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:37.263274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:37.264240 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.264516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.264791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] PATH_INFO: `/v3/users/ddab0c5f110c41eba9629f8020db02fa` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.266015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddab0c5f110c41eba9629f8020db02fa)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:37.267980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:37.317307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddab0c5f110c41eba9629f8020db02fa'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.323978 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddab0c5f110c41eba9629f8020db02fa'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.335501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddab0c5f110c41eba9629f8020db02fa'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.336238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddab0c5f110c41eba9629f8020db02fa'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.345236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a57bf8e4-8823-4789-90e8-59c084732904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddab0c5f110c41eba9629f8020db02fa'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.351495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1208/2423] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:37 2022] DELETE /identity/v3/users/ddab0c5f110c41eba9629f8020db02fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:37.541099 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:37.542600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:37.561917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24a25-6bb0-432e-9e65-677d3abbd1f6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:37.622159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:37.623076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.623399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.623676 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] PATH_INFO: `/v3/projects/114e0c095df64647bf339f0e8dcf8571` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.624980 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=114e0c095df64647bf339f0e8dcf8571)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:37.626967 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:37.676922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114e0c095df64647bf339f0e8dcf8571', 'request_id': 'req-fa051987-a95e-488c-99c9-005412117abf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.682321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114e0c095df64647bf339f0e8dcf8571', 'request_id': 'req-fa051987-a95e-488c-99c9-005412117abf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.692185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114e0c095df64647bf339f0e8dcf8571', 'request_id': 'req-fa051987-a95e-488c-99c9-005412117abf'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.704169 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] The token cache is being invalidate because project 114e0c095df64647bf339f0e8dcf8571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:37.704363 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.705065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fa051987-a95e-488c-99c9-005412117abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:37.706736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1216/2424] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:37 2022] DELETE /identity/v3/projects/114e0c095df64647bf339f0e8dcf8571 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:37.712501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.712785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.713343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.734618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:37.736007 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:37.796967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1209/2425] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:37.804833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.805125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.805402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.825934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:37.827209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:37.839450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1217/2426] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:37.844566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:37.857572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fa269-5d38-40a2-9ed1-b784a79f4a69 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:37.863725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:37.864389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.864662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.864925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.865642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:41:37.865955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:37.867572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:37.881001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1210/2427] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:41:37.886292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:37.902361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a82a9-694d-49b4-93b1-25555c47d0f2 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:37.909266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:37.909931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:37.910208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:37.910480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:37.911214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:37.913128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:37.941418 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1218/2428] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:37 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:37.945628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:37.956231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670e1a-abee-49b9-87d3-567cc46a27e0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.013198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.013893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.014167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.014433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.015153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.017059 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.039718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1211/2429] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:37 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:38.043725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.054217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf1d2-52bc-41bc-a72c-dc12221e4078 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.059403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.060071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.060440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.060792 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.061533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.064078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.077699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1219/2430] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:38.078604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.088464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d6f8f-2fcf-4a8e-afcb-5f0707742901 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.095065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.095758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.096033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.096298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.097028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.098616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8f87-df66-4d7b-a986-e872984cc873 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.108687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1212/2431] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:38.113346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.124189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33626ed6-af76-47b5-b184-cc0edb4c02a3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.128939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.129969 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.130132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.130393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] PATH_INFO: `/v3/projects/091946852a0f49a1b55e6adeb57b52c2/users/519313d4257846b08642fddf53150a24/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.146618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091946852a0f49a1b55e6adeb57b52c2, user_id=519313d4257846b08642fddf53150a24, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.149317 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.165981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1220/2432] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:38 2022] PUT /identity/v3/projects/091946852a0f49a1b55e6adeb57b52c2/users/519313d4257846b08642fddf53150a24/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:38.177296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.177640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.177850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.207912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] MFA Rules not processed for user `519313d4257846b08642fddf53150a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:38.209044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:38.279534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1213/2433] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:38.284342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.350068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f5b1-fb6d-4a7b-8b44-917b1f55e8b3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.355212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.355900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.356182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.356461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.357208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.359245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.388454 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1221/2434] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:38.392722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.403525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25404887-38f0-4cb3-b131-a6a06f2d3c21 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.459875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.460465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.460744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.461013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.461722 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.463686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.486681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1214/2435] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:38 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:38.491761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.502896 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61fb3-e3e9-4d8d-9925-ac95baf587ec admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.508139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.508798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.509078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.509356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.510089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.511727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.522437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1222/2436] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:38.526817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.537581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded32fe1-dd15-4d75-bc7d-691511292869 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.544044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.544976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.545257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.545531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] PATH_INFO: `/v3/projects/97448d5ea8f74bd79143ee7b0614b572/users/9278b7e08ef5428faf1878a09a9ba63b/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.561425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97448d5ea8f74bd79143ee7b0614b572, user_id=9278b7e08ef5428faf1878a09a9ba63b, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.564135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.579156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1215/2437] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:38 2022] PUT /identity/v3/projects/97448d5ea8f74bd79143ee7b0614b572/users/9278b7e08ef5428faf1878a09a9ba63b/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:38.583335 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.597887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78eb59-c3c5-44bb-ab0d-bf7a0bfbd811 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.654443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.655155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.655455 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.655707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.656458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.658065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173d06f-886e-4c30-9dc2-77a7d5f0b583 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.668052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1223/2438] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:38.672391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.682638 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221403-c7f4-4e15-9c56-651e6c4b6ab4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.687520 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.688469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.688861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.689074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] PATH_INFO: `/v3/projects/97448d5ea8f74bd79143ee7b0614b572/users/9278b7e08ef5428faf1878a09a9ba63b/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.691443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=97448d5ea8f74bd79143ee7b0614b572, user_id=9278b7e08ef5428faf1878a09a9ba63b, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.694397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.705327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1216/2439] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:38 2022] PUT /identity/v3/projects/97448d5ea8f74bd79143ee7b0614b572/users/9278b7e08ef5428faf1878a09a9ba63b/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:38.717197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.717420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.717700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.744071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] MFA Rules not processed for user `9278b7e08ef5428faf1878a09a9ba63b`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:38.745704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:38.813618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1224/2440] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:38.823642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.825572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:38.883435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9b1a-f47c-4908-b04f-e3bdcfd54aaa admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.887148 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.887787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.888037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.888334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:38.897825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:38.899355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:38.909106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1217/2441] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:38.980319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:38.990635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4322f-94ac-4576-8dd6-a41ed691cc94 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:38.995884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:38.996541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:38.996826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:38.997104 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:39.054260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:39.055995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d63c7-8eba-48ff-93f3-fe5bbecd2fb3 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:39.065602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1225/2442] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:48.903826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:48.971142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9534e-171f-4950-976f-b3aa1ed93442 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:48.976740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:48.977616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:48.977898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:48.978168 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] PATH_INFO: `/v3/users/519313d4257846b08642fddf53150a24` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:48.979546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519313d4257846b08642fddf53150a24)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:48.981503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:49.033982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519313d4257846b08642fddf53150a24'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.040741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519313d4257846b08642fddf53150a24'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.057275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519313d4257846b08642fddf53150a24'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.058437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519313d4257846b08642fddf53150a24'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.067926 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519313d4257846b08642fddf53150a24'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.073970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1218/2443] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:48 2022] DELETE /identity/v3/users/519313d4257846b08642fddf53150a24 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:49.078829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:49.079359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:49.079359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:49.101941 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:49.104004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:49.171771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1226/2444] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:49.181747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:49.183367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:49.240262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b24bf-7f52-491c-9e09-d55ce7ae2f90 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:49.244727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:49.245372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:49.245650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:49.245921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:49.255456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:49.256896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:49.266286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1219/2445] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:49.636142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:49.637737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:49.652815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d5772-2193-492f-9069-0c2fd88a9ff4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:49.659848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:49.660791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:49.661002 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:49.661266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] PATH_INFO: `/v3/projects/091946852a0f49a1b55e6adeb57b52c2` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:49.662728 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091946852a0f49a1b55e6adeb57b52c2)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:49.664703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:49.712258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091946852a0f49a1b55e6adeb57b52c2', 'request_id': 'req-2deb9939-7d84-4c19-b6ab-093d45f46524'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.717633 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091946852a0f49a1b55e6adeb57b52c2', 'request_id': 'req-2deb9939-7d84-4c19-b6ab-093d45f46524'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.726252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091946852a0f49a1b55e6adeb57b52c2', 'request_id': 'req-2deb9939-7d84-4c19-b6ab-093d45f46524'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.737352 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] The token cache is being invalidate because project 091946852a0f49a1b55e6adeb57b52c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:49.737631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.738242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.739794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1227/2446] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:49 2022] DELETE /identity/v3/projects/091946852a0f49a1b55e6adeb57b52c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:49.744324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:49.753961 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52113f84-68c2-4533-9fdd-97d419d4477b service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:49.818437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:49.819370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:49.819666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:49.819937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] PATH_INFO: `/v3/users/9278b7e08ef5428faf1878a09a9ba63b` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:49.821251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9278b7e08ef5428faf1878a09a9ba63b)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:49.823219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:49.872006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9278b7e08ef5428faf1878a09a9ba63b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.878501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9278b7e08ef5428faf1878a09a9ba63b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.895416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9278b7e08ef5428faf1878a09a9ba63b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.896438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9278b7e08ef5428faf1878a09a9ba63b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.907256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-55f8261e-24f5-4b4a-bb10-c4e8ce1d0c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9278b7e08ef5428faf1878a09a9ba63b'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:49.913380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1220/2447] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:41:49 2022] DELETE /identity/v3/users/9278b7e08ef5428faf1878a09a9ba63b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:50.189568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.191238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:50.206900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9939-7d84-4c19-b6ab-093d45f46524 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.266757 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.267634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.267944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.268259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] PATH_INFO: `/v3/projects/97448d5ea8f74bd79143ee7b0614b572` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.269533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97448d5ea8f74bd79143ee7b0614b572)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.271499 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.320102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97448d5ea8f74bd79143ee7b0614b572', 'request_id': 'req-4cb7ed07-0e32-409e-9b94-046decb5e4e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:50.325940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97448d5ea8f74bd79143ee7b0614b572', 'request_id': 'req-4cb7ed07-0e32-409e-9b94-046decb5e4e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:50.334855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97448d5ea8f74bd79143ee7b0614b572', 'request_id': 'req-4cb7ed07-0e32-409e-9b94-046decb5e4e2'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:50.345821 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] The token cache is being invalidate because project 97448d5ea8f74bd79143ee7b0614b572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:41:50.346105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:50.347377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-4cb7ed07-0e32-409e-9b94-046decb5e4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:41:50.349293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1228/2448] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:41:50 2022] DELETE /identity/v3/projects/97448d5ea8f74bd79143ee7b0614b572 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:50.354438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.354755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.355036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.374460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:50.375689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:50.439522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1221/2449] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:50.447793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.448056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.448364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.474206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:50.482809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:50.493316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1229/2450] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:50.498280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.508309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef369d3-5a76-4841-8742-1712e47bc9fb None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.513339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.514000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.514279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.514546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.515325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:41:50.515630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.517272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.529410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1222/2451] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:41:50.534012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.543689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b474a7-15ed-4d62-a742-c114212ef214 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.549642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.550302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.550566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.550900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.551601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.553513 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.583087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1230/2452] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:50.588732 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.600047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4281-db0e-4faf-99ae-c889cb4e01e8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.657759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.658441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.658775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.659053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.659758 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.661682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.683189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1223/2453] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:50.687291 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.699029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68fc93-ce42-4989-b5f6-0c9597069cd8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.703807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.704485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.704777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.705054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.705801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.707453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.718100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1231/2454] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:50.722127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.732677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b442f-93e0-4820-b83f-b2f39b8fcd3a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.737529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.738203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.738485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.738816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.739797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.741143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9eb71-6228-401c-9673-c2fe706f6335 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.752072 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1224/2455] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:41:50.756303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.767222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8913c-a5c1-4e13-9ce6-12f91a782737 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.773696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.774608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.774918 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.775192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] PATH_INFO: `/v3/projects/174d5e34578d472a87663f427e74a776/users/399ccd01e26143eb8ea46e3d2cbb7e78/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.790124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174d5e34578d472a87663f427e74a776, user_id=399ccd01e26143eb8ea46e3d2cbb7e78, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.792798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:50.807028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1232/2456] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:50 2022] PUT /identity/v3/projects/174d5e34578d472a87663f427e74a776/users/399ccd01e26143eb8ea46e3d2cbb7e78/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:50.818536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.818862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.819141 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.845361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] MFA Rules not processed for user `399ccd01e26143eb8ea46e3d2cbb7e78`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:50.846479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:50.909541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1225/2457] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:50.914155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:50.975753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039bd5-3506-42f1-9211-e7a23567fb07 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:50.980890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:50.981546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:50.981831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:50.982100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:50.982852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:50.984775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.016338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1233/2458] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:41:50 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:51.020559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.031363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89225868-a5a0-4ffb-9a01-2c4bbf68a3b9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.100253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.100825 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.101100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.101367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.102070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.104019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.126179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1226/2459] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:41:51 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:41:51.130349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.141480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a835e-17bb-4bf8-a630-7f640f4aa286 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.146791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.147449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.147731 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.147998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.148739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.150344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.161760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1234/2460] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:51.165853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.176030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6c71-171d-46b1-94fa-ca92b3c3d19f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.181039 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.181918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.182192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.182454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] PATH_INFO: `/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82/users/868ca278400749b1bec8c0438ef75117/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.198137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=d976c8c1e1224b298f2a6c36eb54ef82, user_id=868ca278400749b1bec8c0438ef75117, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.200826 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.217017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1227/2461] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:51 2022] PUT /identity/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82/users/868ca278400749b1bec8c0438ef75117/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:51.221218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.231285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f8c0-0bc8-4a64-8097-ba82aeaaeb75 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.287880 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.288553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.288837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.289117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.289891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.291574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9e87f-3a46-42b8-865b-aa004ada074a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.301883 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1235/2462] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:41:51.306095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.316911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f579bf-a7ad-41cf-ab20-101d0c252ede admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.322927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.323817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.324095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.324365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] PATH_INFO: `/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82/users/868ca278400749b1bec8c0438ef75117/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.326604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d976c8c1e1224b298f2a6c36eb54ef82, user_id=868ca278400749b1bec8c0438ef75117, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.329675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.341062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1228/2463] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:41:51 2022] PUT /identity/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82/users/868ca278400749b1bec8c0438ef75117/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:41:51.352856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.353411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.353787 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.388424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] MFA Rules not processed for user `868ca278400749b1bec8c0438ef75117`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:41:51.390458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:51.463118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1236/2464] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:41:51 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:41:51.474584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.477497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:41:51.546681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ebc73-59eb-4e7b-889a-17885681e0c2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.551092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.551733 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.552008 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.552285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.561834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.563419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.572771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1229/2465] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:51 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:41:51.655239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:41:51.665921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751b057-a041-4890-9e79-e7bff057a6c4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:41:51.669945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:41:51.670606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:41:51.670913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:41:51.671185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:41:51.731184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:41:51.732647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558f601-81bf-402f-9238-7eff15eaaead service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:41:51.741546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1237/2466] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:41:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:00.890185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:00.952855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af636abc-1c3f-43c7-b46a-a2a2fbd51981 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:00.957481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:00.958396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:00.958677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:00.958975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] PATH_INFO: `/v3/users/399ccd01e26143eb8ea46e3d2cbb7e78` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:00.960285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=399ccd01e26143eb8ea46e3d2cbb7e78)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:00.962253 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:01.009641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399ccd01e26143eb8ea46e3d2cbb7e78'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.016693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399ccd01e26143eb8ea46e3d2cbb7e78'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.028717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399ccd01e26143eb8ea46e3d2cbb7e78'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.029392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399ccd01e26143eb8ea46e3d2cbb7e78'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.037491 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399ccd01e26143eb8ea46e3d2cbb7e78'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.043506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1230/2467] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:00 2022] DELETE /identity/v3/users/399ccd01e26143eb8ea46e3d2cbb7e78 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:01.048179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:01.048722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:01.048722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:01.069711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:01.070997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:01.133431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1238/2468] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:42:01.143328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:01.144824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:01.204643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a42db9-04e9-4421-b9f6-a573cf1bf8b8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:01.209261 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:01.210009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:01.210283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:01.210535 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:01.220279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:01.221715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:01.231050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1231/2469] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:42:01.547136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:01.548589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:01.561860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf54f3-1d52-4f7c-b0a4-24efc9c81168 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:01.569332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:01.570219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:01.570561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:01.570809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] PATH_INFO: `/v3/projects/174d5e34578d472a87663f427e74a776` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:01.572403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=174d5e34578d472a87663f427e74a776)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:01.574350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:01.624206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174d5e34578d472a87663f427e74a776', 'request_id': 'req-53364a45-8bab-4c80-bd32-482df1a05a6a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.629442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174d5e34578d472a87663f427e74a776', 'request_id': 'req-53364a45-8bab-4c80-bd32-482df1a05a6a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.637771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174d5e34578d472a87663f427e74a776', 'request_id': 'req-53364a45-8bab-4c80-bd32-482df1a05a6a'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.648618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] The token cache is being invalidate because project 174d5e34578d472a87663f427e74a776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:01.648872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.649521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.651190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1239/2470] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:01 2022] DELETE /identity/v3/projects/174d5e34578d472a87663f427e74a776 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:01.655274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:01.664955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef32f-7bd2-40b0-b80a-43b7602110e5 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:01.721688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:01.722478 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:01.722783 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:01.723046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] PATH_INFO: `/v3/users/868ca278400749b1bec8c0438ef75117` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:01.724283 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868ca278400749b1bec8c0438ef75117)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:01.726270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:01.777156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868ca278400749b1bec8c0438ef75117'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.784047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868ca278400749b1bec8c0438ef75117'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.795239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868ca278400749b1bec8c0438ef75117'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.795948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868ca278400749b1bec8c0438ef75117'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.804921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-361cc20a-6473-423a-a764-87e947152756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868ca278400749b1bec8c0438ef75117'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:01.811269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1232/2471] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:01 2022] DELETE /identity/v3/users/868ca278400749b1bec8c0438ef75117 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:02.115157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.116740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:02.129650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364a45-8bab-4c80-bd32-482df1a05a6a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.185806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.186686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.187063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.187215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] PATH_INFO: `/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.188437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d976c8c1e1224b298f2a6c36eb54ef82)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.190382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.237267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd976c8c1e1224b298f2a6c36eb54ef82', 'request_id': 'req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:02.243661 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd976c8c1e1224b298f2a6c36eb54ef82', 'request_id': 'req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:02.252424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd976c8c1e1224b298f2a6c36eb54ef82', 'request_id': 'req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:02.263220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] The token cache is being invalidate because project d976c8c1e1224b298f2a6c36eb54ef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:02.263434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:02.264015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f1c4a3d1-ddad-4680-8c4f-c172d976bd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:02.265530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1240/2472] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:02 2022] DELETE /identity/v3/projects/d976c8c1e1224b298f2a6c36eb54ef82 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:02.270592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.271108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.271377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.289371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:02.290558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:02.354024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1233/2473] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:02.365955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.366297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.366688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.391355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:02.392542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:02.401910 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1241/2474] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:02.406287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.416307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b561bd7-fa2f-4a91-a928-8791a274391b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.421773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.422418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.422685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.422994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.423721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:42:02.424022 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.425650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.436897 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1234/2475] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:42:02.441194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.450403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca79708-8172-4a80-bc03-0bbaa4e4d327 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.456217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.456874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.457152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.457423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.458135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.460114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.488230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1242/2476] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:02.492404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.502773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242bf59-e123-443c-ba7a-8054fe47a16f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.556629 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.557289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.557567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.557843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.558529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.560488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.581813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1235/2477] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:02.586068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.597114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884cae-1baf-42e7-a837-87806109bd64 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.602463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.603184 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.603451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.603727 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.604459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.606044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.616264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1243/2478] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:02.620439 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.630324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69bffa-3e71-49b7-bed9-8854e44d05c5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.635381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.636040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.636321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.636625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.637364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.639099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b948c-4982-4ba0-aa9d-583bdf651b23 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.649552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1236/2479] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:02.653895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.664193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddf5-e8c3-4e83-8259-8b4f248f6220 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.669240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.670137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.670417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.670705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] PATH_INFO: `/v3/projects/1dc138db541e499fa79babcd018c355f/users/e31b0bff68334620bb63093055402e54/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.686629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc138db541e499fa79babcd018c355f, user_id=e31b0bff68334620bb63093055402e54, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.689524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.703718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1244/2480] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:02 2022] PUT /identity/v3/projects/1dc138db541e499fa79babcd018c355f/users/e31b0bff68334620bb63093055402e54/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:02.715096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.715382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.715658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.741534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] MFA Rules not processed for user `e31b0bff68334620bb63093055402e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:02.742774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:02.805573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1237/2481] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:42:02.810198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.870474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a5df-61e1-4ff5-9732-5af96c558236 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.875538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.876209 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.876490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.876763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.877483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.879493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:02.906108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1245/2482] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:02.910388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:02.921157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f14b4b-5871-4d7c-b56d-7cf33c94f1e7 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:02.980798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:02.981541 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:02.981822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:02.982090 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:02.982846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:02.984762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.013437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1238/2483] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:42:02 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:42:03.017439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:03.029080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe751d2-c124-45f3-8d71-6c799e58269c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:03.034574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:03.035272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.035553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.035827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.036567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:03.038171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.050358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1246/2484] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:03.054568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:03.065205 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad2495-3e5e-4c79-b6cd-df99e18ddad9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:03.071326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:03.072214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.072492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.072765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] PATH_INFO: `/v3/projects/376ab1253e034cfe990cc34f6a2450e0/users/e9095bc450784c3e8d57e87da26ff38a/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.089080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=376ab1253e034cfe990cc34f6a2450e0, user_id=e9095bc450784c3e8d57e87da26ff38a, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:03.091794 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.106729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1239/2485] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:03 2022] PUT /identity/v3/projects/376ab1253e034cfe990cc34f6a2450e0/users/e9095bc450784c3e8d57e87da26ff38a/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:03.110837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:03.121522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6601-f7a7-45b2-9999-07ead5d8ccf3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:03.180235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:03.180932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.181248 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.181495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.182277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:03.183916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1a49-47fe-4cc7-9092-e454fda2f7b9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.195445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1247/2486] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:03.199666 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:03.212568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c242-efb8-47d3-b193-7c3dc2ea36ef admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:03.218413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:03.219667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.220121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.220567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] PATH_INFO: `/v3/projects/376ab1253e034cfe990cc34f6a2450e0/users/e9095bc450784c3e8d57e87da26ff38a/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.222867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376ab1253e034cfe990cc34f6a2450e0, user_id=e9095bc450784c3e8d57e87da26ff38a, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:03.226132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.239974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1240/2487] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:03 2022] PUT /identity/v3/projects/376ab1253e034cfe990cc34f6a2450e0/users/e9095bc450784c3e8d57e87da26ff38a/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:03.252698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.253013 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.253226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.284372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] MFA Rules not processed for user `e9095bc450784c3e8d57e87da26ff38a`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:03.286346 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:03.367111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1248/2488] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:03.377874 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:03.380673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:03.448378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a429a-668c-4932-b581-2694b3a21c08 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:03.452853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:03.453511 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:03.453792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:03.454062 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:03.511631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:03.513088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c234-cdf7-4475-99e8-dbdaed2127cc service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:03.522061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1241/2489] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:08.122073 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:08.132290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4ea76-9a68-43a4-b010-4f09ee873ed0 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:08.136059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:08.136710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:08.136986 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:08.137256 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:08.147721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:08.150437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:08.160976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:08.161494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:08.161606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1249/2490] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:08.161704 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:08.182217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] MFA Rules not processed for user `fc1ef6f6170f4ccb9e3b439ac3fd56e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:08.183470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:08.238677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1242/2491] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:42:08.274322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:08.275811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:08.352651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f459-1275-4828-a242-6a21e3fc96c7 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:08.356386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:08.357026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:08.357277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:08.357570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:08.359355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:08.452032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:08.453822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab343c8-0a9a-40ff-98a6-a09289466dcb service glance] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:08.476441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1250/2492] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:09.060805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:09.062277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:09.119236 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da16c6b-b700-41d0-9e89-fb84651ad385 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:09.123470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:09.124133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:09.124416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:09.124787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:09.126814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:09.141743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:09.143232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:09.156327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1243/2493] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:42:18.333884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1de1-2257-4c29-836c-32cde83c1b23 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:18.334519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1de1-2257-4c29-836c-32cde83c1b23 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:18.334519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1de1-2257-4c29-836c-32cde83c1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:18.353355 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-33db1de1-2257-4c29-836c-32cde83c1b23 None None] MFA Rules not processed for user `1521bf93314c437798ef374963def38e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:18.354561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-33db1de1-2257-4c29-836c-32cde83c1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:18.411868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1251/2494] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:18.733852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:18.742789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179e68-0c6a-4489-8647-dada48cb7ff0 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:18.747608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:18.748248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:18.748530 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:18.748797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:18.750853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:18.760894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:18.762320 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b184a13-26c1-4f80-8f28-37761e3b77fc service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:18.770207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1244/2495] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:19.229506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10d35-33fd-4003-87a4-6b33fbdf037f None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:19.229798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10d35-33fd-4003-87a4-6b33fbdf037f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:19.230105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10d35-33fd-4003-87a4-6b33fbdf037f None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:19.231929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1252/2496] 10.222.0.32 () {54 vars in 960 bytes} [Thu Feb 10 03:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:42:19.237234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:19.237626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:19.238180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:19.277893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] MFA Rules not processed for user `b3d2d4a5e36d4d39909faf4bf065f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:19.279129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:19.343573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1245/2497] 10.222.0.32 () {58 vars in 1057 bytes} [Thu Feb 10 03:42:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:19.358224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10d35-33fd-4003-87a4-6b33fbdf037f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:19.375804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10d35-33fd-4003-87a4-6b33fbdf037f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:19.381789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:19.382447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:19.382782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:19.383062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:19.385032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:19.396882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:19.398613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:19.408950 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1253/2498] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:22.601745 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:22.603384 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:22.615695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d108eb-ff12-4de4-9ddb-33636433a918 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:22.620286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:22.620932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:22.621209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:22.621464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:22.623599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:22.633917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:22.635337 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:22.643245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1246/2499] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:25.412971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:25.415631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:25.437052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea625-12ec-4e00-8230-09a8dad2d794 service placement] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:25.446298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:25.447048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:25.447336 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:25.447613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:25.449863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:25.461687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:25.463325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:25.476399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1254/2500] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:28.722239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:28.735627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeff0c-7bcd-448e-8a40-0f56c3bc6b69 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:28.741468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:28.742109 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:28.742389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:28.742679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:28.744919 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:28.802944 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:28.804566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:28.814081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1247/2501] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:31.739160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:31.750313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea33c-0cef-4594-821d-04466c32d047 service nova] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:31.755911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:31.756551 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:31.756827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:31.757097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:31.759060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:31.770691 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:31.772286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df824ec3-39b4-425f-a93d-7b1f7b127788 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:31.782766 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1255/2502] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:33.130574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:33.205518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b303-9852-46e7-a3e7-57c2b45284bf service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:33.210635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:33.211762 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:33.212190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:33.212833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] PATH_INFO: `/v3/users/e31b0bff68334620bb63093055402e54` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:33.214287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31b0bff68334620bb63093055402e54)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:33.216573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:33.278928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31b0bff68334620bb63093055402e54'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.285715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31b0bff68334620bb63093055402e54'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.297894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31b0bff68334620bb63093055402e54'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.298621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31b0bff68334620bb63093055402e54'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.308939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31b0bff68334620bb63093055402e54'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.324111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1248/2503] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:33 2022] DELETE /identity/v3/users/e31b0bff68334620bb63093055402e54 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:33.328702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:33.329168 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:33.329448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:33.346682 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:33.348118 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:33.407028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1256/2504] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:33.417025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:33.418553 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:33.478449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e607c-af0f-4cbe-afda-ba25d9748f07 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:33.482621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:33.483312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:33.483583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:33.483838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:33.494002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:33.495486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:33.505296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1249/2505] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:33.779818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:33.781480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:33.794424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1cc5c-a713-41f3-9b31-c82a763b1241 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:33.800213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:33.801096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:33.801383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:33.801657 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] PATH_INFO: `/v3/projects/1dc138db541e499fa79babcd018c355f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:33.802999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc138db541e499fa79babcd018c355f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:33.804919 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:33.853189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc138db541e499fa79babcd018c355f', 'request_id': 'req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.859043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc138db541e499fa79babcd018c355f', 'request_id': 'req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.868878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc138db541e499fa79babcd018c355f', 'request_id': 'req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.880329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] The token cache is being invalidate because project 1dc138db541e499fa79babcd018c355f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:33.880592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.881243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:33.882824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1257/2506] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:33 2022] DELETE /identity/v3/projects/1dc138db541e499fa79babcd018c355f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:33.887184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:33.896827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9b16-1f21-48df-9d96-193a34d0cdce service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:33.953801 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:33.954685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:33.954980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:33.955259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] PATH_INFO: `/v3/users/e9095bc450784c3e8d57e87da26ff38a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:33.956482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9095bc450784c3e8d57e87da26ff38a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:33.958415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.006739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9095bc450784c3e8d57e87da26ff38a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.013859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9095bc450784c3e8d57e87da26ff38a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.027304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9095bc450784c3e8d57e87da26ff38a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.028036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9095bc450784c3e8d57e87da26ff38a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.036134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4748bfab-5479-45b9-8a34-2434c9b0b0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9095bc450784c3e8d57e87da26ff38a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.042409 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1250/2507] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:33 2022] DELETE /identity/v3/users/e9095bc450784c3e8d57e87da26ff38a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:34.306945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.308873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:34.340449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3215e4-e9ca-44cb-865c-92c5d00f5ce1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.402630 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.403251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.403539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.403994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] PATH_INFO: `/v3/projects/376ab1253e034cfe990cc34f6a2450e0` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.405215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] RBAC: Authorizing `identity:delete_project(project_id=376ab1253e034cfe990cc34f6a2450e0)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.407845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.464052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376ab1253e034cfe990cc34f6a2450e0', 'request_id': 'req-86911964-ba7b-45b1-8282-6cc9b28d09de'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.469270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376ab1253e034cfe990cc34f6a2450e0', 'request_id': 'req-86911964-ba7b-45b1-8282-6cc9b28d09de'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.477913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376ab1253e034cfe990cc34f6a2450e0', 'request_id': 'req-86911964-ba7b-45b1-8282-6cc9b28d09de'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.489096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] The token cache is being invalidate because project 376ab1253e034cfe990cc34f6a2450e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:34.489381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.489999 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-86911964-ba7b-45b1-8282-6cc9b28d09de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:34.491579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1258/2508] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:34 2022] DELETE /identity/v3/projects/376ab1253e034cfe990cc34f6a2450e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:34.497045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.497527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.497637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.515742 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:34.516983 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:34.581306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1251/2509] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:34.588258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.588788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.589321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.609504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:34.610861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:34.620273 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1259/2510] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:34.625003 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.635425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95249ce-0b23-460d-85ec-ee7742e283f9 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.641206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.641901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.642175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.642492 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.643244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:42:34.643856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.645515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.659298 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1252/2511] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:42:34.663602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.674343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2103544-617c-4292-b5f5-76e3226fbed9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.679247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.679978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.680230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.680518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.681225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.683174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.720704 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1260/2512] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:42:34 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:34.720834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.727357 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cfa4-d3ab-4e9e-94ce-2245edfdb4ab admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.780741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.781421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.781713 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.781968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.782696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.784696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.810946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1253/2513] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:42:34 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:34.815771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.828351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b55ca-9a6f-466b-bdc7-d4866e1b4ee8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.834962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.835629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.835914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.836253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.837054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.838683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.849502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1261/2514] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:42:34.853749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.864031 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb65b-9982-463e-817b-807d9bb0cef9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.870345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.871107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.871413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.871667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.872393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.873994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beec64-629c-46d7-bc12-19b55c49ed52 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.884336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1254/2515] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:34.888642 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:34.899743 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421746-8a95-4484-8066-634523fd4532 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:34.904577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:34.905529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.905807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.906077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] PATH_INFO: `/v3/projects/01dbdcf9a851490c878f62722c322ea5/users/b3e69a4a922b463ab294d2a8980d05b3/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.921709 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dbdcf9a851490c878f62722c322ea5, user_id=b3e69a4a922b463ab294d2a8980d05b3, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:34.924384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:34.941423 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1262/2516] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:34 2022] PUT /identity/v3/projects/01dbdcf9a851490c878f62722c322ea5/users/b3e69a4a922b463ab294d2a8980d05b3/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:34.956223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:34.956513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:34.956786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:34.983772 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] MFA Rules not processed for user `b3e69a4a922b463ab294d2a8980d05b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:34.984982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:35.064550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1255/2517] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:35.071544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.142443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f552c4-44f5-4202-803a-6e08adf7655e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.148098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.148922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.149206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.149462 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.150175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.152247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.178854 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1263/2518] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:42:35 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:35.183237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.194301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd03f5a-8487-4de4-ac3a-42d53f58e85b None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.252829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.253508 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.253782 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.254040 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.254813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.256787 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.280744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1256/2519] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:42:35 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:35.284962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.295136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73df67-0c9d-46d4-a99a-fe541135aaf6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.299667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.300326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.300605 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.300876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.301607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.303229 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.313712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1264/2520] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:42:35.318338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.329340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861eb47-0047-4be7-b570-bac45ab7c774 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.334052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.334986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.335321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.335810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] PATH_INFO: `/v3/projects/5941abea779145f38c1294d9c6e4ea1f/users/fa1ec645154149c796d4bbc79bd9bf9a/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.352658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5941abea779145f38c1294d9c6e4ea1f, user_id=fa1ec645154149c796d4bbc79bd9bf9a, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.355522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.370038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1257/2521] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:35 2022] PUT /identity/v3/projects/5941abea779145f38c1294d9c6e4ea1f/users/fa1ec645154149c796d4bbc79bd9bf9a/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:35.374125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.385269 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122355d-e906-40b2-ba47-6d77d162bd6d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.450271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.450982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.451263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.451535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.452274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.453863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f7a2f-248a-4f11-bea3-dc2f45822887 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.464576 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1265/2522] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:35.468442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.478962 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849bde-0e37-4e33-8ee3-e1952fa2ae51 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.483750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.484634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.484911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.485178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] PATH_INFO: `/v3/projects/5941abea779145f38c1294d9c6e4ea1f/users/fa1ec645154149c796d4bbc79bd9bf9a/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.487173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5941abea779145f38c1294d9c6e4ea1f, user_id=fa1ec645154149c796d4bbc79bd9bf9a, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.489780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.500538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1258/2523] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:35 2022] PUT /identity/v3/projects/5941abea779145f38c1294d9c6e4ea1f/users/fa1ec645154149c796d4bbc79bd9bf9a/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:35.510931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.511222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.511501 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.538754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] MFA Rules not processed for user `fa1ec645154149c796d4bbc79bd9bf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:35.540234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:35.609026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1266/2524] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:35.618990 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.620985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:35.677096 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723999-d59a-4d8d-adb3-1556a13a6c42 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.681207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.681849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.682127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.682393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.693083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.694534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.704613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1259/2525] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:35.794022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:35.803850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4231c-48c5-4e66-9810-30db246edc5b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:35.807750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:35.808388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:35.808669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:35.808946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:35.874081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:35.875491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360ab98-956e-4b1d-9d9e-2bc96ecb033a service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:35.884304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1267/2526] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:38.459457 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:38.531411 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985130-4880-4f43-9b14-383aa8607c52 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:38.536107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:38.537237 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:38.537519 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:38.537788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] PATH_INFO: `/v3/users/b3e69a4a922b463ab294d2a8980d05b3` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:38.539112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e69a4a922b463ab294d2a8980d05b3)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:38.541153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:38.588047 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e69a4a922b463ab294d2a8980d05b3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:38.595020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e69a4a922b463ab294d2a8980d05b3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:38.606382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e69a4a922b463ab294d2a8980d05b3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:38.607180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e69a4a922b463ab294d2a8980d05b3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:38.614844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e69a4a922b463ab294d2a8980d05b3'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:38.621934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1260/2527] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:38 2022] DELETE /identity/v3/users/b3e69a4a922b463ab294d2a8980d05b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:38.626503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:38.627123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:38.627123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:38.644394 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:38.645607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:38.706245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1268/2528] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:38.716092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:38.717640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:38.781997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34af4-46c4-4c5c-8448-9922dd7e06cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:38.787910 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:38.788582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:38.788852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:38.789111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:38.799291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:38.800730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:38.813611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1261/2529] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:39.211126 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:39.212560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:39.226449 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb775-9b28-48ee-8da1-ddbaac8795ea None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:39.233500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:39.234432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:39.234718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:39.235032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] PATH_INFO: `/v3/projects/01dbdcf9a851490c878f62722c322ea5` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:39.236230 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dbdcf9a851490c878f62722c322ea5)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:39.238205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:39.286705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dbdcf9a851490c878f62722c322ea5', 'request_id': 'req-3da02e7e-217d-4509-8a92-fcda046d0df7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.291811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dbdcf9a851490c878f62722c322ea5', 'request_id': 'req-3da02e7e-217d-4509-8a92-fcda046d0df7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.300187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dbdcf9a851490c878f62722c322ea5', 'request_id': 'req-3da02e7e-217d-4509-8a92-fcda046d0df7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.311867 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] The token cache is being invalidate because project 01dbdcf9a851490c878f62722c322ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:39.312187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.312902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.314533 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1269/2530] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:39 2022] DELETE /identity/v3/projects/01dbdcf9a851490c878f62722c322ea5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:39.318679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:39.328696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51572642-dd79-4716-8b9d-bc22e4a36e52 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:39.386386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:39.387349 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:39.387646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:39.387915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] PATH_INFO: `/v3/users/fa1ec645154149c796d4bbc79bd9bf9a` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:39.389251 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1ec645154149c796d4bbc79bd9bf9a)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:39.391636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:39.441760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1ec645154149c796d4bbc79bd9bf9a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.448880 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1ec645154149c796d4bbc79bd9bf9a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.460506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1ec645154149c796d4bbc79bd9bf9a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.461272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1ec645154149c796d4bbc79bd9bf9a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.473158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-b71aee0c-2e37-4d41-954f-0caa6f14b584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1ec645154149c796d4bbc79bd9bf9a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.479968 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1262/2531] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:42:39 2022] DELETE /identity/v3/users/fa1ec645154149c796d4bbc79bd9bf9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:39.765321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:39.766888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:39.779771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da02e7e-217d-4509-8a92-fcda046d0df7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:39.838377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:39.839762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:39.840097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:39.840472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] PATH_INFO: `/v3/projects/5941abea779145f38c1294d9c6e4ea1f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:39.842028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5941abea779145f38c1294d9c6e4ea1f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:39.844035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:39.891098 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5941abea779145f38c1294d9c6e4ea1f', 'request_id': 'req-0b27610d-0120-4448-be79-d492ccc8b1a3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.897616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5941abea779145f38c1294d9c6e4ea1f', 'request_id': 'req-0b27610d-0120-4448-be79-d492ccc8b1a3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.905583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5941abea779145f38c1294d9c6e4ea1f', 'request_id': 'req-0b27610d-0120-4448-be79-d492ccc8b1a3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.917782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] The token cache is being invalidate because project 5941abea779145f38c1294d9c6e4ea1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:42:39.918113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.918758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0b27610d-0120-4448-be79-d492ccc8b1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:42:39.920287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1270/2532] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:42:39 2022] DELETE /identity/v3/projects/5941abea779145f38c1294d9c6e4ea1f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:42:39.925438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:39.925751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:39.926048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:39.943451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:39.944641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:40.006485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1263/2533] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:40.016342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.016639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.017032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.036386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:40.037585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:40.046519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1271/2534] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:40.051041 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.060665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65288-2c00-4243-988d-ae1fde4be7f8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.065463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.066222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.066380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.066642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.067429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:42:40.067729 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.069416 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.081234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1264/2535] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:42:40.085648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.095162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc546-53be-47c8-bda4-67dc1c273e9b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.100196 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.100856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.101136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.101439 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.102139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.104162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.133943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1272/2536] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:42:40 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:40.135187 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.145108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4776ec-9887-411d-8f3a-3afe97ebd284 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.199364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.200021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.200293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.200567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.201249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.203254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.224587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1265/2537] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:42:40 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:42:40.229060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.239434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2400-46f0-4096-8526-9df560cf106c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.244741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.245419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.245753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.246023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.246779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.248389 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.261226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1273/2538] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:40.264454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.274452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5725ae1-19a6-4c7f-ad49-04ec92a5afa7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.279479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.280155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.280431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.280699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.281435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.283093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83602b88-4832-41d9-9896-bff4ab75a640 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.293188 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1266/2539] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:42:40.297809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.308588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdba3e-c130-41b4-a89e-af6f5e9150a1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.314393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.315425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.315703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.315988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] PATH_INFO: `/v3/projects/086bafc01f8042f7a389257f0c880323/users/362be7f505aa45de8a9adfbb005ec793/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.331702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] RBAC: Authorizing `identity:create_grant(project_id=086bafc01f8042f7a389257f0c880323, user_id=362be7f505aa45de8a9adfbb005ec793, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.334424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.349069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1274/2540] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:42:40 2022] PUT /identity/v3/projects/086bafc01f8042f7a389257f0c880323/users/362be7f505aa45de8a9adfbb005ec793/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:42:40.359200 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b2ec-17da-4d23-b320-7758f17aaf35 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.359485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b2ec-17da-4d23-b320-7758f17aaf35 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.359759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b2ec-17da-4d23-b320-7758f17aaf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.386595 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-3b79b2ec-17da-4d23-b320-7758f17aaf35 None None] MFA Rules not processed for user `362be7f505aa45de8a9adfbb005ec793`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:40.387861 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3b79b2ec-17da-4d23-b320-7758f17aaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:40.455374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1267/2541] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:42:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:40.466858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:40.468623 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:40.523626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68306-4707-4430-9bd9-120f0a4d55df admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:40.527179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:40.527824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:40.528102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:40.528373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:40.537483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:40.538948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:40.547491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1275/2542] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:42:42.996001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:42.996447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:42.996674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:43.048905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:43.050120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:43.125605 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1268/2543] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:42:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:42:43.178687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:43.180667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:43.281645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809bd79-8374-4f82-ab0a-a1609d2dcc47 service glance] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:43.287200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:43.288181 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:43.288527 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:43.288869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:43.297185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:43.298814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:43.309035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1276/2544] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:42:45.181682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:45.184317 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:45.311504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe9bf-fc20-4134-86c7-2333d22ccb28 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:45.328645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:45.329552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:45.330016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:45.330443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:45.332433 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:45.345264 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:45.346869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4335e-d1a5-45ae-b7f7-1cf5cbaa12d5 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:45.358857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1269/2545] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:53.654942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:53.682461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b08447-8e54-419c-a9f1-a88cd0b14c00 service swift] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:53.690405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:53.691556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:53.692258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:53.692726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:53.695182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:53.722982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:53.724813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96997-307b-49d1-9932-628ff43ae324 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:53.746300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1277/2546] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:58.160173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ce0-f03e-4cf7-99a4-7bf74b85f8fe None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.160854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ce0-f03e-4cf7-99a4-7bf74b85f8fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.160854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ce0-f03e-4cf7-99a4-7bf74b85f8fe None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.162938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1270/2547] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:42:58.169816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acd22-b1e4-4dda-88a7-483783195e14 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.170388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acd22-b1e4-4dda-88a7-483783195e14 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.170388 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acd22-b1e4-4dda-88a7-483783195e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.221171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-915acd22-b1e4-4dda-88a7-483783195e14 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:58.222565 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-915acd22-b1e4-4dda-88a7-483783195e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:58.237144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1278/2548] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:42:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:58.256356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a3ce0-f03e-4cf7-99a4-7bf74b85f8fe None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:58.269979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a3ce0-f03e-4cf7-99a4-7bf74b85f8fe None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:58.275203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:58.276360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.276847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.277285 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.291532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:58.293162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a705f-5d16-4d0f-b67a-1deb4756a94a service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:58.309698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1271/2549] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:58.378424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.378749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.379032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] PATH_INFO: `/` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.381028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1279/2550] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:42:58.386403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ceb4a-4286-4aca-800b-88f7f9f286d7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.386711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ceb4a-4286-4aca-800b-88f7f9f286d7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.386988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ceb4a-4286-4aca-800b-88f7f9f286d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.406878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-051ceb4a-4286-4aca-800b-88f7f9f286d7 None None] MFA Rules not processed for user `8f0955fb6d7347afb65d3acec567eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:58.408112 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-051ceb4a-4286-4aca-800b-88f7f9f286d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:58.464015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1272/2551] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:42:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:58.476466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:58.478264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:58.492422 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126628-f9ed-419f-8c45-8efb3fd00e28 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:58.496816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:58.497489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.497774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.498106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.506853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:58.508357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ea437-d0d0-4304-83ff-cc04c11b0159 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:58.518149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1280/2552] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:42:58.611690 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae14b-0d4d-465d-bc4e-5ef2d133cd5c None None] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.611975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae14b-0d4d-465d-bc4e-5ef2d133cd5c None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.612247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae14b-0d4d-465d-bc4e-5ef2d133cd5c None None] PATH_INFO: `/` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.614134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1273/2553] 10.222.0.32 () {54 vars in 921 bytes} [Thu Feb 10 03:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 10 03:42:58.620555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ca76-2b3e-4b7a-9491-9f52f75acda3 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.620852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ca76-2b3e-4b7a-9491-9f52f75acda3 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.621130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ca76-2b3e-4b7a-9491-9f52f75acda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.640235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-0ab1ca76-2b3e-4b7a-9491-9f52f75acda3 None None] MFA Rules not processed for user `74c6cf5d4bba4126a0a94a4db29dee52`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:42:58.641524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0ab1ca76-2b3e-4b7a-9491-9f52f75acda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:42:58.651582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1281/2554] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Feb 10 03:42:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:42:58.662054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fae14b-0d4d-465d-bc4e-5ef2d133cd5c None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:42:58.675724 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fae14b-0d4d-465d-bc4e-5ef2d133cd5c None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:42:58.679472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:42:58.680099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:42:58.680376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:42:58.680645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:42:58.691486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:42:58.692959 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:42:58.703648 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1274/2555] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:03.150712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1bf87-252f-4d48-9d75-e948fc515606 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:03.151212 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1bf87-252f-4d48-9d75-e948fc515606 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:03.151321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1bf87-252f-4d48-9d75-e948fc515606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:03.169738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7ab1bf87-252f-4d48-9d75-e948fc515606 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:03.170973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7ab1bf87-252f-4d48-9d75-e948fc515606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:03.178820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1282/2556] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Feb 10 03:43:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:03.191269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:03.203344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac043-55f2-404f-bc9d-20a1c9dc4a8e service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:03.208931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:03.209581 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:03.209862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:03.210139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:03.218412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:03.220052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:03.228418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1275/2557] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:14.495789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:14.496340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:14.496340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:14.516152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:14.517874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:14.526234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1283/2558] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:14.538682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:14.549178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921888-0eea-45a8-9f18-4efd07346744 service swift] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:14.555220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:14.555894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:14.556178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:14.556477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:14.566206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:14.567893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd37d5a-be22-4883-8123-175f7f017a6e service swift] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:14.576098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1276/2559] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:15.249039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:15.313399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad7dc-e06f-444e-a860-b0283acb72be None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:15.317815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:15.318701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:15.318998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:15.319258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] PATH_INFO: `/v3/users/362be7f505aa45de8a9adfbb005ec793` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:15.320438 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362be7f505aa45de8a9adfbb005ec793)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:15.322367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:15.370091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362be7f505aa45de8a9adfbb005ec793'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.382318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362be7f505aa45de8a9adfbb005ec793'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.383165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362be7f505aa45de8a9adfbb005ec793'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.391890 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362be7f505aa45de8a9adfbb005ec793'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.403141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362be7f505aa45de8a9adfbb005ec793'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.409681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1284/2560] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:15 2022] DELETE /identity/v3/users/362be7f505aa45de8a9adfbb005ec793 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:15.414481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:15.414792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:15.415063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:15.433092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:15.434249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:15.492599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1277/2561] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:15.503253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:15.504826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:15.570307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae0a12-b4f8-4e6b-aedd-19b5699eb413 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:15.575526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:15.576603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:15.577048 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:15.577496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:15.588514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:15.590026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6af60f-b4f0-4a8a-9a1a-4f36b267b10b service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:15.599822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1285/2562] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:15.876736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:15.878735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:15.892558 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19725886-49db-41ca-8396-d99fa5e3a79f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:15.903091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:15.904030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:15.904303 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:15.904574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] PATH_INFO: `/v3/projects/086bafc01f8042f7a389257f0c880323` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:15.906837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086bafc01f8042f7a389257f0c880323)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:15.908936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:15.964156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086bafc01f8042f7a389257f0c880323', 'request_id': 'req-9b35977c-784a-4dbf-b7a3-e4e43d133d28'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.969987 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086bafc01f8042f7a389257f0c880323', 'request_id': 'req-9b35977c-784a-4dbf-b7a3-e4e43d133d28'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.978844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086bafc01f8042f7a389257f0c880323', 'request_id': 'req-9b35977c-784a-4dbf-b7a3-e4e43d133d28'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.991428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] The token cache is being invalidate because project 086bafc01f8042f7a389257f0c880323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:15.991695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.992526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9b35977c-784a-4dbf-b7a3-e4e43d133d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:15.994760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1278/2563] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:15 2022] DELETE /identity/v3/projects/086bafc01f8042f7a389257f0c880323 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:16.000914 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.001226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.001488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.028556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:16.029803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:16.116195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1286/2564] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:16.126426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.126793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.127074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.150909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:16.152394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:16.163299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1279/2565] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:16.164931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.175771 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c04a-21f3-4be8-9b09-864a95944085 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.180793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.181466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.181754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.182028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.182800 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:43:16.183109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.184921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.197838 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1287/2566] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:43:16.201911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.210943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28227-7e2d-49f6-bad8-f52a7c0aedbf None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.215608 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.216389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.216664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.216932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.217627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.219696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.250848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1280/2567] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:16 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:16.253737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.263506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115d320-e5f8-44a2-b5e9-826e30828c64 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.317945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.318617 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.318932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.319201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.319884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.321807 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.341723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1288/2568] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:16 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:16.345893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.356403 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188a2a-0484-45c1-9993-3df78463d63b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.363073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.364456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.364456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.364456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.365088 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.366755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.384014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.385006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1281/2569] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:16.396277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f325-a9fe-45c0-acb1-7291eaba82a6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.401815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.402699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.403107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.403600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.404463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.407606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4384a-b3cc-442d-ac90-3f034b364ed1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.418191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1289/2570] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:43:16.422582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.436169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5a0-1ddf-4427-a4b8-36efa99e9556 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.441132 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.442121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.442463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.442809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] PATH_INFO: `/v3/projects/21da704f6d034f169cc078836f15225e/users/aa37393e74214a16a86b001a2aa9537d/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.458843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=21da704f6d034f169cc078836f15225e, user_id=aa37393e74214a16a86b001a2aa9537d, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.461599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.479230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1282/2571] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:16 2022] PUT /identity/v3/projects/21da704f6d034f169cc078836f15225e/users/aa37393e74214a16a86b001a2aa9537d/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:16.490045 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.490497 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.490881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.519295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] MFA Rules not processed for user `aa37393e74214a16a86b001a2aa9537d`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:16.521362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:16.590786 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1290/2572] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:16.601664 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:16.603694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:16.668167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c8c69-cc3c-48a3-ab0f-5c5b120643cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:16.676554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:16.677505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:16.678113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:16.678561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:16.688280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:16.689989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:16.701142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1283/2573] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:21.994334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:21.996003 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:22.062560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49606014-e9ee-4439-9b40-c170a2ef3a97 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:22.067427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:22.068308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.068587 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.068858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] PATH_INFO: `/v3/users/3117cb6d65454365be315814d9d696cc` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.070077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3117cb6d65454365be315814d9d696cc)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:22.072041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:22.123084 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3117cb6d65454365be315814d9d696cc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.131979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3117cb6d65454365be315814d9d696cc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.132669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3117cb6d65454365be315814d9d696cc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.139569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3117cb6d65454365be315814d9d696cc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.150922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3117cb6d65454365be315814d9d696cc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.156927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1291/2574] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:21 2022] DELETE /identity/v3/users/3117cb6d65454365be315814d9d696cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:22.344928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:22.355984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4c1ff-1718-4ea0-818e-3b95dca6a323 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:22.418227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:22.419790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.420111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.420387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] PATH_INFO: `/v3/projects/f8d44d08ec564e94b99156087796bf3d` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.422093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d44d08ec564e94b99156087796bf3d)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:22.424027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:22.473105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d44d08ec564e94b99156087796bf3d', 'request_id': 'req-ff57297d-6e4e-4058-a73f-3ff153e9812d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.479084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d44d08ec564e94b99156087796bf3d', 'request_id': 'req-ff57297d-6e4e-4058-a73f-3ff153e9812d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.488111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d44d08ec564e94b99156087796bf3d', 'request_id': 'req-ff57297d-6e4e-4058-a73f-3ff153e9812d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.499931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] The token cache is being invalidate because project f8d44d08ec564e94b99156087796bf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:22.500214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.500843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ff57297d-6e4e-4058-a73f-3ff153e9812d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.502422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1284/2575] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:22 2022] DELETE /identity/v3/projects/f8d44d08ec564e94b99156087796bf3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:22.506463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:22.507944 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:22.520913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119b592-303f-4f1f-a373-4e14e4315530 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:22.578020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:22.578998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.579284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.579544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] PATH_INFO: `/v3/users/9c2cfa9e6fb148b49facd7c2c67ebd4f` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.580876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2cfa9e6fb148b49facd7c2c67ebd4f)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:22.582917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:22.639835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2cfa9e6fb148b49facd7c2c67ebd4f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.648775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2cfa9e6fb148b49facd7c2c67ebd4f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.649414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2cfa9e6fb148b49facd7c2c67ebd4f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.656879 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2cfa9e6fb148b49facd7c2c67ebd4f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.658467 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.658778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.659043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.672862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2cfa9e6fb148b49facd7c2c67ebd4f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:22.677457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1292/2576] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:22 2022] DELETE /identity/v3/users/9c2cfa9e6fb148b49facd7c2c67ebd4f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:22.687216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] MFA Rules not processed for user `862a7e9af971415ab1e8c9cb325994f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:22.687216 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:22.747230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1285/2577] 10.222.0.32 () {58 vars in 967 bytes} [Thu Feb 10 03:43:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:43:22.762498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:22.763960 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:22.834272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145fdbe-d628-4f87-b4cb-2837791c3b71 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:22.839816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e93de4f4c34d25bbb086fc94bca1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:22.840529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.840815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.841092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.849303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:22.850942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55186003-0177-41c4-b7d3-0aca983e9577 service swift] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:22.859185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1293/2578] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Feb 10 03:43:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:22.878867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:22.880734 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:22.958352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d414-73bb-4c47-8f93-7b6bcb5d9179 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:22.964402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:22.965338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:22.965675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:22.966036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] PATH_INFO: `/v3/projects/044916832bf14a368645d7af3f9c7da4` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:22.967198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=044916832bf14a368645d7af3f9c7da4)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:22.969380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.021021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044916832bf14a368645d7af3f9c7da4', 'request_id': 'req-5013c6a4-d89b-4db1-91de-1c8531eb84ff'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.026432 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044916832bf14a368645d7af3f9c7da4', 'request_id': 'req-5013c6a4-d89b-4db1-91de-1c8531eb84ff'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.035661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044916832bf14a368645d7af3f9c7da4', 'request_id': 'req-5013c6a4-d89b-4db1-91de-1c8531eb84ff'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.049289 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] The token cache is being invalidate because project 044916832bf14a368645d7af3f9c7da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:23.049791 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.051071 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5013c6a4-d89b-4db1-91de-1c8531eb84ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.053117 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1286/2579] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:22 2022] DELETE /identity/v3/projects/044916832bf14a368645d7af3f9c7da4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:23.059845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622460-dc81-4339-8737-578d457f1c04 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.060345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622460-dc81-4339-8737-578d457f1c04 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.060443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622460-dc81-4339-8737-578d457f1c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.078189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-99622460-dc81-4339-8737-578d457f1c04 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:23.079434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-99622460-dc81-4339-8737-578d457f1c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:23.140302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1294/2580] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:23.148720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.149093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.149375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.168448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:23.169811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:23.178038 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1287/2581] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:23.182703 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622460-dc81-4339-8737-578d457f1c04 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.192358 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622460-dc81-4339-8737-578d457f1c04 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.197296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.197964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.198261 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.198538 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.199305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:43:23.199621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.201351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.218060 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1295/2582] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:43:23.222746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.232604 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e942171-a6d0-46a1-8624-9de2533d6aff None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.237686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.238441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.238832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.239166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.239955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.242023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.272286 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1288/2583] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:23.276664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.288392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f574-e2c5-4822-aebd-4f3958c4fa5c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.346139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.346852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.347135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.347403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.348119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.350083 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.373517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1296/2584] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:23.377736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.389081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b8655-f31d-4f8f-9b04-a58a09a25963 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.394397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.395032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.395425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.395706 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.396522 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.398167 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.408623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1289/2585] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:23.412796 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.424191 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904809-f350-4d00-9fc1-b76e89940921 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.429908 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.430720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.431338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.431591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.432344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.434260 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c4681-3f4b-4968-9338-7c002b48d5c0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.444738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1297/2586] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:43:23.449043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.459423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a521d74-e43b-4fff-aeed-676e1e27effc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.464056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.464946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.465224 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.465568 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] PATH_INFO: `/v3/projects/69a1b85d278c49969a6a638dd37579d6/users/87291059637f46ca8985768611d1acf5/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.481655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a1b85d278c49969a6a638dd37579d6, user_id=87291059637f46ca8985768611d1acf5, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.484415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.505939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1290/2587] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:23 2022] PUT /identity/v3/projects/69a1b85d278c49969a6a638dd37579d6/users/87291059637f46ca8985768611d1acf5/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:23.508063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.508407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.508689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.527350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:23.528568 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:23.589020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1298/2588] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:23.604932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.606894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:23.668197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f296a1-052a-42ef-a825-8a77fe2c1997 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.672157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.672810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.673823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.674392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.684544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.686076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90c55-3b2e-4f68-84da-fd3e34bbdaa4 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.696256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1291/2589] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:43:23.818322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:23.820805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:23.834399 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4bb7-80c6-430b-8332-e0a57ee0985f None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:23.839663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:23.841085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.841431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.841940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] PATH_INFO: `/v3/users/aa37393e74214a16a86b001a2aa9537d` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.843298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa37393e74214a16a86b001a2aa9537d)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:23.845524 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:23.909544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa37393e74214a16a86b001a2aa9537d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.918904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa37393e74214a16a86b001a2aa9537d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.919740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa37393e74214a16a86b001a2aa9537d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.928206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa37393e74214a16a86b001a2aa9537d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.942067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa37393e74214a16a86b001a2aa9537d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:23.951650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1299/2590] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:23 2022] DELETE /identity/v3/users/aa37393e74214a16a86b001a2aa9537d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:23.954423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:23.954625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:23.955584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:23.978089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:23.979582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:24.045260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1292/2591] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:24.064384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:24.066361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:24.131556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da9b7-85c5-4d50-a69b-f17021606e84 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:24.136472 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:24.137150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:24.137437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:24.137708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:24.148088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:24.149552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a298e9-3a09-4150-9f40-02464ea0a04e service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:24.159932 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1300/2592] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:24.446377 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:24.455689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:24.473614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2faff-995e-49a1-adf2-0686187285b7 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:24.478397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:24.479284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:24.479563 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:24.480015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] PATH_INFO: `/v3/projects/21da704f6d034f169cc078836f15225e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:24.481554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21da704f6d034f169cc078836f15225e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:24.483616 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:24.533773 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21da704f6d034f169cc078836f15225e', 'request_id': 'req-dc288db3-4f23-4a23-a424-6988c08519d9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:24.539263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21da704f6d034f169cc078836f15225e', 'request_id': 'req-dc288db3-4f23-4a23-a424-6988c08519d9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:24.547382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21da704f6d034f169cc078836f15225e', 'request_id': 'req-dc288db3-4f23-4a23-a424-6988c08519d9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:24.558615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] The token cache is being invalidate because project 21da704f6d034f169cc078836f15225e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:24.558927 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:24.559574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:24.561510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1293/2593] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:24 2022] DELETE /identity/v3/projects/21da704f6d034f169cc078836f15225e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:27.862868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:27.863376 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:27.863492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:27.890302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] MFA Rules not processed for user `87291059637f46ca8985768611d1acf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:27.891590 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:27.968678 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1301/2594] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:27.973228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:27.974715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:28.039846 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc288db3-4f23-4a23-a424-6988c08519d9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.044760 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.045451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.045741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.046017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.046751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.048703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.080326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1294/2595] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:27 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:28.084627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:28.115216 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67232a54-33ec-4e31-ab84-adba9c9bcee9 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.194049 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.196144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.196428 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.196701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.197463 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.199531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.226588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1302/2596] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:28 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:28.230334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:28.241274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac71d4-6146-40f0-b01c-e4b6ca966db0 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.246922 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.247695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.248140 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.248476 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.249291 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.251028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.266231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:28.267202 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1295/2597] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:28.278994 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29b21-48d7-45fb-95f1-4319bff99be4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.283431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.284419 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.284758 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.285095 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] PATH_INFO: `/v3/projects/6153f4fd9e97416e818a483c91e5e9c5/users/68cdb49e1d644975be7acd2319c82020/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.301005 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6153f4fd9e97416e818a483c91e5e9c5, user_id=68cdb49e1d644975be7acd2319c82020, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.303785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.322372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1303/2598] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:28 2022] PUT /identity/v3/projects/6153f4fd9e97416e818a483c91e5e9c5/users/68cdb49e1d644975be7acd2319c82020/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:28.326461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:28.337073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132771ae-0af0-4017-8788-afcd859f641a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.406545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.407422 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.407774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.408095 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.408917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.411550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d42350-3355-4864-89f9-dbb2ca480e7b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.426515 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1296/2599] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:28.427882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:28.440594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e619c-2d30-4018-a59d-03091cbf24fb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:28.445970 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:28.446955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:28.447425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:28.447878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] PATH_INFO: `/v3/projects/6153f4fd9e97416e818a483c91e5e9c5/users/68cdb49e1d644975be7acd2319c82020/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:28.450125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6153f4fd9e97416e818a483c91e5e9c5, user_id=68cdb49e1d644975be7acd2319c82020, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:28.453620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:28.470569 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1304/2600] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:28 2022] PUT /identity/v3/projects/6153f4fd9e97416e818a483c91e5e9c5/users/68cdb49e1d644975be7acd2319c82020/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:33.592855 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fdd05-0ef9-4c81-96b4-fbff5fb0a719 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:33.593809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fdd05-0ef9-4c81-96b4-fbff5fb0a719 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:33.594036 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fdd05-0ef9-4c81-96b4-fbff5fb0a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:33.625739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ad6fdd05-0ef9-4c81-96b4-fbff5fb0a719 None None] MFA Rules not processed for user `68cdb49e1d644975be7acd2319c82020`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:33.627004 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ad6fdd05-0ef9-4c81-96b4-fbff5fb0a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:33.696719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1297/2601] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:33.710065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:33.712116 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:33.782804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1342-aa74-4370-9928-40448723ad87 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:33.788860 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:33.789517 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:33.789799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:33.790075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:33.845054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:33.846554 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:33.855602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1305/2602] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:35.215301 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:35.215862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:35.216445 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:35.238578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] MFA Rules not processed for user `87291059637f46ca8985768611d1acf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:35.238578 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:35.244361 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1298/2603] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:43:38.676713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:38.678280 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:38.735939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d255-9828-46a1-9adb-8763763d05cd service nova] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:38.740094 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:38.740759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:38.741037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:38.741313 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:38.743768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:38.808113 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:38.809816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:38.820856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1306/2604] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:42.486446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:42.488235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:42.517399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b735fd-52bc-4f34-b86e-fab0490bf27d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:42.524143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:42.525101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:42.526027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:42.526306 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] PATH_INFO: `/v3/users/fc1ef6f6170f4ccb9e3b439ac3fd56e0` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:42.527610 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1ef6f6170f4ccb9e3b439ac3fd56e0)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:42.529524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:42.574834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.583404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.597562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.598466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.607890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bb95f141-dd3b-4420-b25a-5cc1e6ce2581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.614995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1299/2605] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:42 2022] DELETE /identity/v3/users/fc1ef6f6170f4ccb9e3b439ac3fd56e0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:42.800300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:42.810356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf915-2b07-4653-b1b4-fb148224569d service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:42.875351 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:42.876855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:42.877198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:42.877537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] PATH_INFO: `/v3/projects/f327fcae4b024948a911ad1bdeb06ad9` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:42.879069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f327fcae4b024948a911ad1bdeb06ad9)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:42.881154 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:42.927917 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f327fcae4b024948a911ad1bdeb06ad9', 'request_id': 'req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.933156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f327fcae4b024948a911ad1bdeb06ad9', 'request_id': 'req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.942105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f327fcae4b024948a911ad1bdeb06ad9', 'request_id': 'req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.953442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] The token cache is being invalidate because project f327fcae4b024948a911ad1bdeb06ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:42.953730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.954369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-80b2a8b9-3537-4ca5-9795-6fac1b317ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:42.955989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1307/2606] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:42 2022] DELETE /identity/v3/projects/f327fcae4b024948a911ad1bdeb06ad9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:42.961085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:42.961372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:42.961649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:42.980354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:42.981538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:43.039182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1300/2607] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:43.048425 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.048844 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.049195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.074803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:43.075995 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:43.085334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1308/2608] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:43.089728 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.100163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3a068-dce3-4ef8-9c6e-96df53f7e1b3 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.106092 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.106786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.107061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.107338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.108080 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:43:43.108387 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.110010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.122964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1301/2609] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:43:43.127550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.138382 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ab876-b7d0-4a3a-9403-805d2a7dbd92 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.145205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.145930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.146461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.146767 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.147677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.150092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.180773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1309/2610] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:43.187081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.197759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824c71c-5633-490e-afc4-37c1d461fc59 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.253392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.254065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.254347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.254624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.255360 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.258107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.280067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1302/2611] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:43.284316 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.294855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3d92-42fb-441c-bf62-70f04461051a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.299975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.300640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.300909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.301177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.301909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.303567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.314271 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1310/2612] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:43.318153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.328164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283acbd-d4e1-4923-ad6a-d077ae3588b9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.333016 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.333693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.333966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.334250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.335021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.336594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041b97e-e7d9-493f-8fd3-6b8d6be80ae5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.346374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1303/2613] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:43.350669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.360444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b51b-f160-42d0-87a9-d4b82228edd3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.365759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.366680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.366972 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.367244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] PATH_INFO: `/v3/projects/2f18b4cf51ad440f847e2ba6dfef4676/users/d7151d5a98a241db8946c95b03db2c35/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.382304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f18b4cf51ad440f847e2ba6dfef4676, user_id=d7151d5a98a241db8946c95b03db2c35, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.384958 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.401487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1311/2614] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:43 2022] PUT /identity/v3/projects/2f18b4cf51ad440f847e2ba6dfef4676/users/d7151d5a98a241db8946c95b03db2c35/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:43.415714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.416916 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.417197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.447547 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] MFA Rules not processed for user `d7151d5a98a241db8946c95b03db2c35`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:43.448660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:43.512551 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1304/2615] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:43.519103 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.586954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789d5e-feff-44a9-bde3-8cc8c70eec78 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.593277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.593940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.594227 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.594490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.595314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.597240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.625805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1312/2616] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:43.630163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.641154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc0aa6-dad9-4c75-b2d7-40298fe3bfe5 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.710029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.710693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.710963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.711234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.711943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.713904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.739665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1305/2617] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:43.744467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.755668 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86036d-6b69-400c-b08c-d5e704a5a6d9 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.760705 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.761343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.761625 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.761904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.762641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.764277 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.774674 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1313/2618] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:43.778807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.789821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1145-00bc-4393-ad9e-5bb5c4dd2fd8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.794189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.795110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.795392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.795660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] PATH_INFO: `/v3/projects/c94e054edff547c6bd67939ba167f68b/users/7be543eb98ec4a2a852970877d82970e/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.811043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94e054edff547c6bd67939ba167f68b, user_id=7be543eb98ec4a2a852970877d82970e, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.813740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.829402 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1306/2619] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:43 2022] PUT /identity/v3/projects/c94e054edff547c6bd67939ba167f68b/users/7be543eb98ec4a2a852970877d82970e/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:43.833443 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.843456 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e71ad-73e1-4701-8c29-b288f159b9cf admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.902057 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.902749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.903032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.903302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.904034 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.905621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb1d0-2252-4701-8325-2f410e4bef23 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.915367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1314/2620] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:43.919988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:43.930937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0efbc-b542-47e2-95f9-49a8f46ea441 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:43.937313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:43.938309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.938585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.938992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] PATH_INFO: `/v3/projects/c94e054edff547c6bd67939ba167f68b/users/7be543eb98ec4a2a852970877d82970e/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.941356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94e054edff547c6bd67939ba167f68b, user_id=7be543eb98ec4a2a852970877d82970e, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:43.944328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:43.962836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1307/2621] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:43 2022] PUT /identity/v3/projects/c94e054edff547c6bd67939ba167f68b/users/7be543eb98ec4a2a852970877d82970e/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:43.968884 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:43.969171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:43.969446 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:43.996479 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] MFA Rules not processed for user `7be543eb98ec4a2a852970877d82970e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:43.997695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:44.066186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1315/2622] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:44.076344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:44.078131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:44.138147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa16b0b-6673-4945-83f2-dd374437742d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:44.142832 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:44.143485 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:44.143764 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:44.144035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:44.154560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:44.156069 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:44.165945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1308/2623] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:44.249862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:44.259948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c915-ccfa-490e-838a-98edbf44b43e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:44.264100 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:44.264737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:44.265022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:44.265296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:44.325427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:44.326909 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bedd20-02b3-4139-a32c-af6806499972 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:44.335834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1316/2624] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:47.062521 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:47.131143 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc49-49bc-4d9b-90cc-2f27628b1c05 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:47.136393 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:47.137260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:47.137550 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:47.137817 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] PATH_INFO: `/v3/users/d7151d5a98a241db8946c95b03db2c35` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:47.139078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7151d5a98a241db8946c95b03db2c35)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:47.140988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:47.186805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7151d5a98a241db8946c95b03db2c35'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.194153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7151d5a98a241db8946c95b03db2c35'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.205245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7151d5a98a241db8946c95b03db2c35'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.205994 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7151d5a98a241db8946c95b03db2c35'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.215365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7151d5a98a241db8946c95b03db2c35'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.221370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1309/2625] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:47 2022] DELETE /identity/v3/users/d7151d5a98a241db8946c95b03db2c35 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:47.226117 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:47.226802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:47.227044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:47.247242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:47.248598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:47.308044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1317/2626] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:47.318505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:47.320163 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:47.383885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91b86-5523-41c5-8259-9e8bcf4ad1ac admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:47.388524 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:47.389174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:47.389446 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:47.389714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:47.399363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:47.400793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:47.410336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1310/2627] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:47.699545 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:47.701736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:47.714111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b5d98-11c1-4dac-a1f5-f1485c474ccf None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:47.719795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:47.721265 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:47.721612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:47.722092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] PATH_INFO: `/v3/projects/2f18b4cf51ad440f847e2ba6dfef4676` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:47.723578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f18b4cf51ad440f847e2ba6dfef4676)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:47.725659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:47.773874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f18b4cf51ad440f847e2ba6dfef4676', 'request_id': 'req-d5f215f4-8419-4bae-92f6-189a8ee43df8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.779547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f18b4cf51ad440f847e2ba6dfef4676', 'request_id': 'req-d5f215f4-8419-4bae-92f6-189a8ee43df8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.788646 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f18b4cf51ad440f847e2ba6dfef4676', 'request_id': 'req-d5f215f4-8419-4bae-92f6-189a8ee43df8'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.799493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] The token cache is being invalidate because project 2f18b4cf51ad440f847e2ba6dfef4676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:47.799885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.800556 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.802132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1318/2628] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:47 2022] DELETE /identity/v3/projects/2f18b4cf51ad440f847e2ba6dfef4676 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:47.806300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:47.816480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975516-403d-49c5-888d-b167dae0c26b service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:47.873955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:47.874857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:47.875108 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:47.875372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] PATH_INFO: `/v3/users/7be543eb98ec4a2a852970877d82970e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:47.876593 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be543eb98ec4a2a852970877d82970e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:47.878497 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:47.939233 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be543eb98ec4a2a852970877d82970e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.949408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be543eb98ec4a2a852970877d82970e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.963799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be543eb98ec4a2a852970877d82970e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.964516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be543eb98ec4a2a852970877d82970e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.974013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-be334528-da2b-4701-a0c1-aaad9727247e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be543eb98ec4a2a852970877d82970e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:47.980330 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1311/2629] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:47 2022] DELETE /identity/v3/users/7be543eb98ec4a2a852970877d82970e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:48.253675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.255238 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:48.268327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f215f4-8419-4bae-92f6-189a8ee43df8 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.325689 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.326566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.326882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.327208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] PATH_INFO: `/v3/projects/c94e054edff547c6bd67939ba167f68b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.328375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94e054edff547c6bd67939ba167f68b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.330342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.384657 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94e054edff547c6bd67939ba167f68b', 'request_id': 'req-6587dc69-0445-453c-a3fd-102c9895ccb0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:48.390686 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94e054edff547c6bd67939ba167f68b', 'request_id': 'req-6587dc69-0445-453c-a3fd-102c9895ccb0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:48.399651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94e054edff547c6bd67939ba167f68b', 'request_id': 'req-6587dc69-0445-453c-a3fd-102c9895ccb0'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:48.410730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] The token cache is being invalidate because project c94e054edff547c6bd67939ba167f68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:48.411030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:48.411701 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6587dc69-0445-453c-a3fd-102c9895ccb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:48.413259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1319/2630] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:48 2022] DELETE /identity/v3/projects/c94e054edff547c6bd67939ba167f68b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:48.418483 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.419019 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.419118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.437247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:48.438443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:48.498077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1312/2631] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:48.506895 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.507233 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.507601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.530408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:48.531654 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:48.541079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1320/2632] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:48.545513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.555582 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a50b-0786-415d-ae12-0584bba34d79 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.561014 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.561669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.561952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.562232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.563018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:43:48.563327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.564952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.576995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1313/2633] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:43:48.581522 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.591228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ede5-bd6f-424a-9848-2b0ef773538b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.597814 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.598461 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.598752 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.599038 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.599750 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.601660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.643724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1321/2634] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:48.647901 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.658046 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e023f45-78b7-469f-8cd3-8cd805cce0d7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.719126 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.719804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.720086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.720356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.721073 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.723028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.749953 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1314/2635] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:48.754152 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.768343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93626448-0b39-4ea3-9888-2c915ad85785 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.773620 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.774285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.774561 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.774872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.775585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.777172 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.787482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1322/2636] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:48.791583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.801681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939f5a0-d5fd-4f2b-8238-c5288c468193 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.806854 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.807505 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.807784 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.808169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.808914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.810528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae812c-cd11-47be-84a2-e04531f4610f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.820660 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1315/2637] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:48.825243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:48.838088 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7aac-cb8d-4fe9-9733-018a967165f6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:48.843913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:48.844774 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.845058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.845333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] PATH_INFO: `/v3/projects/25059b3490734fe6a9f8905b45eba441/users/13cd1e1334164f27946778669af2665d/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.861219 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=25059b3490734fe6a9f8905b45eba441, user_id=13cd1e1334164f27946778669af2665d, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:48.863952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:48.880020 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1323/2638] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:48 2022] PUT /identity/v3/projects/25059b3490734fe6a9f8905b45eba441/users/13cd1e1334164f27946778669af2665d/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:48.890643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:48.890955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:48.891234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:48.918952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] MFA Rules not processed for user `13cd1e1334164f27946778669af2665d`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:48.920204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:48.990149 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1316/2639] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:48.997119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.057232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89458-7404-422c-a32b-be20cd4d9bde admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.062768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.063415 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.063688 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.063961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.064648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.066599 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.093357 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1324/2640] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:48 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:49.097702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.109106 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24540-654a-49e5-bb87-5ad908012550 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.164708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.165373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.165650 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.165917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.166614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.168591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.190084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1317/2641] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:49 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:49.196614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.210208 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9eaa-7b63-45f5-ac4e-a1ea47e4b6eb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.215222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.215873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.216147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.216401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.217124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.218737 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.228901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1325/2642] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:49.233110 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.243685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a062-5ca5-4c48-b7b5-a9546f051456 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.249893 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.250436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.250642 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.250952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] PATH_INFO: `/v3/projects/adb73c6105fc4eaab2f922faff3d1305/users/2618bbb9c159482a84734a016bcf04be/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.266094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb73c6105fc4eaab2f922faff3d1305, user_id=2618bbb9c159482a84734a016bcf04be, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.269290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.283231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1318/2643] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:49 2022] PUT /identity/v3/projects/adb73c6105fc4eaab2f922faff3d1305/users/2618bbb9c159482a84734a016bcf04be/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:49.289921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.300788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a543d9c-5f89-42c7-86f5-989e0a7bb3ff admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.355947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.356543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.356877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.357170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.357904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.359548 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad122ee7-5a8a-40ae-bb6f-a19b241d12fd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.369849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1326/2644] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:49.374775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.391234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6fa3-74b1-457f-9cd8-9ac53bc9301f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.397700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.398585 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.398894 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.399169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] PATH_INFO: `/v3/projects/adb73c6105fc4eaab2f922faff3d1305/users/2618bbb9c159482a84734a016bcf04be/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.401451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb73c6105fc4eaab2f922faff3d1305, user_id=2618bbb9c159482a84734a016bcf04be, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.404195 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.414646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1319/2645] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:49 2022] PUT /identity/v3/projects/adb73c6105fc4eaab2f922faff3d1305/users/2618bbb9c159482a84734a016bcf04be/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:49.426817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.427185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.427441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.460560 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] MFA Rules not processed for user `2618bbb9c159482a84734a016bcf04be`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:49.461769 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:49.530780 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1327/2646] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:49.540720 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:49.542725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:49.603612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f20ab-5f36-4222-9519-05d3629e642d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:49.607613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:49.608192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:49.608472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:49.608743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:49.619767 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:49.621206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440eddc-78a7-455b-a429-4077a621a254 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:49.631131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1320/2647] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:50.961768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:51.026234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c85ba-59b8-412e-928d-2ad0698d1a2e None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:51.034712 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:51.035875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:51.036222 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:51.036609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] PATH_INFO: `/v3/users/13cd1e1334164f27946778669af2665d` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:51.038610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cd1e1334164f27946778669af2665d)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:51.041029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:51.089258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cd1e1334164f27946778669af2665d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.098816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cd1e1334164f27946778669af2665d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.099567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cd1e1334164f27946778669af2665d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.107202 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cd1e1334164f27946778669af2665d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.119936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cd1e1334164f27946778669af2665d'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.126067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1328/2648] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:50 2022] DELETE /identity/v3/users/13cd1e1334164f27946778669af2665d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:51.130850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:51.131716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:51.131999 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:51.149998 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:51.151372 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:51.222113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1321/2649] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:51.232123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:51.233776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:51.295831 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41e2a5-d02f-43f2-9c6c-c59f54629357 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:51.300242 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:51.300892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:51.301174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:51.301453 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:51.311223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:51.312738 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:51.322332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1329/2650] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:51.593247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:51.594679 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:51.606345 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f48f7-beda-4fc5-aa34-1dd17cf241aa None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:51.611612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:51.612523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:51.612805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:51.613079 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] PATH_INFO: `/v3/projects/25059b3490734fe6a9f8905b45eba441` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:51.614297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25059b3490734fe6a9f8905b45eba441)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:51.616248 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:51.662257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25059b3490734fe6a9f8905b45eba441', 'request_id': 'req-71cdd0b8-09b3-469b-8ac8-582413506cf4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.667454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25059b3490734fe6a9f8905b45eba441', 'request_id': 'req-71cdd0b8-09b3-469b-8ac8-582413506cf4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.676174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25059b3490734fe6a9f8905b45eba441', 'request_id': 'req-71cdd0b8-09b3-469b-8ac8-582413506cf4'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.688374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] The token cache is being invalidate because project 25059b3490734fe6a9f8905b45eba441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:51.688743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.689494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.691212 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1322/2651] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:51 2022] DELETE /identity/v3/projects/25059b3490734fe6a9f8905b45eba441 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:51.695194 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:51.705245 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3bf4-9095-4397-af4e-71a2dcbf1db8 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:51.761640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:51.762435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:51.762756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:51.763016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] PATH_INFO: `/v3/users/2618bbb9c159482a84734a016bcf04be` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:51.764215 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2618bbb9c159482a84734a016bcf04be)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:51.766165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:51.821173 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2618bbb9c159482a84734a016bcf04be'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.832130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2618bbb9c159482a84734a016bcf04be'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.832820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2618bbb9c159482a84734a016bcf04be'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.839618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2618bbb9c159482a84734a016bcf04be'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.850998 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-1e809071-074c-4bc8-aa0d-ba999315a32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2618bbb9c159482a84734a016bcf04be'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:51.857952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1330/2652] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:43:51 2022] DELETE /identity/v3/users/2618bbb9c159482a84734a016bcf04be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:52.126449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.127918 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:52.151150 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd0b8-09b3-469b-8ac8-582413506cf4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.215625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.216494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.216771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.217035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] PATH_INFO: `/v3/projects/adb73c6105fc4eaab2f922faff3d1305` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.218215 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb73c6105fc4eaab2f922faff3d1305)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.220299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.265689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb73c6105fc4eaab2f922faff3d1305', 'request_id': 'req-01e77dc0-6372-4886-ab6d-7299685490c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:52.270857 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb73c6105fc4eaab2f922faff3d1305', 'request_id': 'req-01e77dc0-6372-4886-ab6d-7299685490c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:52.278995 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb73c6105fc4eaab2f922faff3d1305', 'request_id': 'req-01e77dc0-6372-4886-ab6d-7299685490c5'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:52.290951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] The token cache is being invalidate because project adb73c6105fc4eaab2f922faff3d1305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:43:52.291242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:52.291950 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-01e77dc0-6372-4886-ab6d-7299685490c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:43:52.293625 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1323/2653] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:43:52 2022] DELETE /identity/v3/projects/adb73c6105fc4eaab2f922faff3d1305 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:52.300819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.301305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.301305 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.320069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:52.321264 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:52.382718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1331/2654] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:52.390763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.391121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.391458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.410630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:52.412068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:52.420603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1324/2655] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:52.425079 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.434971 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a902c2-2b7e-44ca-9789-b98a4ff822ad None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.442940 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.443616 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.443893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.444171 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.445239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:43:52.445239 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.447122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.464033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1332/2656] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:43:52.465287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.483334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e444b88-ce1a-48f9-a521-49316e727b52 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.488716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.489408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.489822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.490105 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.490930 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.493386 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.520721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1325/2657] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:52.525115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.536120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff15f0-419d-4445-ab4e-467b749b126a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.592289 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.593054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.593426 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.593761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.594531 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.596544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.621270 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1333/2658] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:52.622580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.634785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb8a5-5304-420a-9128-0be764f3bf03 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.639796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.640997 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.641805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.641805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.642315 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.644034 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.656068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1326/2659] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:52.660112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.670384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965449fd-1830-4207-b4e3-8b1b1f17798e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.676068 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.676815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.677106 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.677379 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.678123 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.679754 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9934-1894-4552-8e7c-d1ec5a190d11 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.693645 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1334/2660] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:52.696939 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.707702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec713599-5c48-4ad2-8c82-39c8408af7e2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.711956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.712848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.713123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.713392 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] PATH_INFO: `/v3/projects/5faf24dff6bb49019dd822c9621ad8ca/users/2caa98c3b5c74ace9ddfd7fc77707327/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.727896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faf24dff6bb49019dd822c9621ad8ca, user_id=2caa98c3b5c74ace9ddfd7fc77707327, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.730545 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.746510 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1327/2661] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:52 2022] PUT /identity/v3/projects/5faf24dff6bb49019dd822c9621ad8ca/users/2caa98c3b5c74ace9ddfd7fc77707327/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:52.758017 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.758308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.758710 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.785801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] MFA Rules not processed for user `2caa98c3b5c74ace9ddfd7fc77707327`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:52.787157 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:52.855370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1335/2662] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:52.859811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.919612 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dff21-4e26-4b88-b721-eb2e9e9a6434 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:52.924441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:52.925174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:52.925523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:52.925863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:52.926662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:52.928662 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:52.955310 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1328/2663] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:43:52.959627 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:52.971816 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087b8d6-1845-403c-9cc4-fe30c253f543 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.029518 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.030203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.030487 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.030809 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.031530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.033574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.054361 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1336/2664] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:52 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:53.058295 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.069436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9d71-de91-4f07-96a7-26c1786710b2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.073862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.074603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.075053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.075374 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.076290 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.077952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.089391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1329/2665] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:53.093801 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.104495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fbf47-08b5-4422-95c4-19a4a285c2ef admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.108943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.109596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.109873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.110146 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.110957 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.112546 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2fcf-9334-41bd-86cd-e5d74ce561c9 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.123405 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1337/2666] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:53.127646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.138355 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ffe7-999a-4f92-9bbd-319b8ff9bd91 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.143808 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.144693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.145068 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.145340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] PATH_INFO: `/v3/projects/43bc1af491184574b74298fc76272a3b/users/8862eff0e97c4f9bafe8d751a6e114bb/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.160185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bc1af491184574b74298fc76272a3b, user_id=8862eff0e97c4f9bafe8d751a6e114bb, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.162850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.180177 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1330/2667] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:53 2022] PUT /identity/v3/projects/43bc1af491184574b74298fc76272a3b/users/8862eff0e97c4f9bafe8d751a6e114bb/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:53.190262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.190637 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.191011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.220275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] MFA Rules not processed for user `8862eff0e97c4f9bafe8d751a6e114bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:53.221584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:53.298199 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1338/2668] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:53.299282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.360548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8c33-2cd8-44c7-877f-1e29102727ff admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.365241 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.365903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.366182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.366454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.367196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.369652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.398135 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1331/2669] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:43:53 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:53.399544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.410447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ef419-d8bf-463a-a570-fe4b79eb1b8b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.469323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.470043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.470310 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.470598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.471402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.473362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.497243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1339/2670] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:43:53 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:43:53.501798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.512862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe00ef2-2a3f-4920-a44d-1369ae0dde61 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.517633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.518299 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.518576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.518914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.519643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.521274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.533182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1332/2671] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:43:53.537427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.547450 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e6389-1c08-46d4-975b-9884b873c026 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.552323 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.553224 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.553502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.553770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] PATH_INFO: `/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b/users/61ae8a36b5c945c4993f33a236313d17/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.569372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ffd1daa3fa44c1a4ac4192511d438b, user_id=61ae8a36b5c945c4993f33a236313d17, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.572127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.586841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1340/2672] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:53 2022] PUT /identity/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b/users/61ae8a36b5c945c4993f33a236313d17/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:53.590803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.601375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141efe-e509-471d-962e-0a8aa766f294 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.657718 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.658401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.658705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.658980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.659726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.661331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc932b5c-75b1-4a5f-af35-d32712896320 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.674552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1333/2673] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:43:53.675925 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.686634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6812bec-d928-42a3-baa7-bf006299cdf0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.692304 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.693300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.693580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.693845 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] PATH_INFO: `/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b/users/61ae8a36b5c945c4993f33a236313d17/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.695997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ffd1daa3fa44c1a4ac4192511d438b, user_id=61ae8a36b5c945c4993f33a236313d17, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.698679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.710669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1341/2674] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:43:53 2022] PUT /identity/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b/users/61ae8a36b5c945c4993f33a236313d17/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:43:53.721081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.721466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.721833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.750334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] MFA Rules not processed for user `61ae8a36b5c945c4993f33a236313d17`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:43:53.751818 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:53.821370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1334/2675] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:43:53.831129 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:53.833120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:53.895131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368433-5d8f-4c86-9d40-33883678c1de admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:53.899043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:53.899684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:53.899966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:53.900240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:53.910278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:53.911693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:53.921684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1342/2676] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:54.408260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:54.410385 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:43:54.424401 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff967d17-3904-4dc6-99db-4ce84ea3d6ac None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:54.428444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:54.429091 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:54.429371 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:54.429634 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:54.489562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:54.492267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:54.502573 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1335/2677] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:43:58.481130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:43:58.490429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea4ab-c017-49b4-8808-d8cef55f15c7 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:43:58.495338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:43:58.495984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:43:58.496253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:43:58.496523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:43:58.557458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:43:58.558935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a31bf9-c330-43e5-b23c-f871911c2db0 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:43:58.567791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1343/2678] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:43:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:00.665864 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:00.729815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2706d8-4fa1-4a21-9aab-99e0742c3ebe service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:00.735560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:00.736474 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:00.736750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:00.737032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] PATH_INFO: `/v3/users/2caa98c3b5c74ace9ddfd7fc77707327` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:00.738365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2caa98c3b5c74ace9ddfd7fc77707327)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:00.740342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:00.795655 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2caa98c3b5c74ace9ddfd7fc77707327'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:00.802470 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2caa98c3b5c74ace9ddfd7fc77707327'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:00.814935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2caa98c3b5c74ace9ddfd7fc77707327'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:00.815699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2caa98c3b5c74ace9ddfd7fc77707327'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:00.824456 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2caa98c3b5c74ace9ddfd7fc77707327'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:00.830399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1336/2679] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:00 2022] DELETE /identity/v3/users/2caa98c3b5c74ace9ddfd7fc77707327 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:00.835040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:00.835511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:00.835621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:00.853777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:00.855139 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:00.922041 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1344/2680] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:00.932120 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:00.933814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:01.002094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb390e-e367-46d4-b144-19efaf9d5d23 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:01.006555 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:01.007228 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:01.007509 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:01.007785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:01.016878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:01.018307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:01.028296 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1337/2681] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:01.305144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:01.306760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:01.320406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ea24-67cb-4357-8da6-20d8c51c98b8 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:01.326309 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:01.327221 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:01.327498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:01.327772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] PATH_INFO: `/v3/projects/5faf24dff6bb49019dd822c9621ad8ca` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:01.329217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faf24dff6bb49019dd822c9621ad8ca)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:01.331327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:01.378931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faf24dff6bb49019dd822c9621ad8ca', 'request_id': 'req-6c17242f-c25c-4988-88ee-f3785664192b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.384200 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faf24dff6bb49019dd822c9621ad8ca', 'request_id': 'req-6c17242f-c25c-4988-88ee-f3785664192b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.392690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faf24dff6bb49019dd822c9621ad8ca', 'request_id': 'req-6c17242f-c25c-4988-88ee-f3785664192b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.403667 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] The token cache is being invalidate because project 5faf24dff6bb49019dd822c9621ad8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:01.403945 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.404563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.406293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1345/2682] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:01 2022] DELETE /identity/v3/projects/5faf24dff6bb49019dd822c9621ad8ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:01.410271 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:01.419652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bf36-c230-410a-a113-249b717f81a8 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:01.474247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:01.475162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:01.475437 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:01.475835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] PATH_INFO: `/v3/users/8862eff0e97c4f9bafe8d751a6e114bb` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:01.477030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8862eff0e97c4f9bafe8d751a6e114bb)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:01.479010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:01.526970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8862eff0e97c4f9bafe8d751a6e114bb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.533567 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8862eff0e97c4f9bafe8d751a6e114bb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.546279 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8862eff0e97c4f9bafe8d751a6e114bb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.547044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8862eff0e97c4f9bafe8d751a6e114bb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.556531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8862eff0e97c4f9bafe8d751a6e114bb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.562754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1338/2683] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:01 2022] DELETE /identity/v3/users/8862eff0e97c4f9bafe8d751a6e114bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:01.847009 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:01.848721 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:01.862119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17242f-c25c-4988-88ee-f3785664192b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:01.917431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:01.918324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:01.918600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:01.918902 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] PATH_INFO: `/v3/projects/43bc1af491184574b74298fc76272a3b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:01.920121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bc1af491184574b74298fc76272a3b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:01.922012 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:01.975504 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bc1af491184574b74298fc76272a3b', 'request_id': 'req-2e51e131-18b1-46f1-b01b-286e0854074b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.981539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bc1af491184574b74298fc76272a3b', 'request_id': 'req-2e51e131-18b1-46f1-b01b-286e0854074b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:01.993482 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bc1af491184574b74298fc76272a3b', 'request_id': 'req-2e51e131-18b1-46f1-b01b-286e0854074b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.007585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] The token cache is being invalidate because project 43bc1af491184574b74298fc76272a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:02.008037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.008983 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.011496 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1346/2684] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:01 2022] DELETE /identity/v3/projects/43bc1af491184574b74298fc76272a3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:02.017029 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.019246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:02.036674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87496-20af-45d3-8749-eb3eb9bfa860 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.094875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.095754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.096032 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.096304 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] PATH_INFO: `/v3/users/61ae8a36b5c945c4993f33a236313d17` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.097532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ae8a36b5c945c4993f33a236313d17)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.099507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.147641 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ae8a36b5c945c4993f33a236313d17'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.153976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ae8a36b5c945c4993f33a236313d17'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.164914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ae8a36b5c945c4993f33a236313d17'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.165590 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ae8a36b5c945c4993f33a236313d17'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.175866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-06470546-2353-4561-bb7c-29cf00a8226a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ae8a36b5c945c4993f33a236313d17'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.182429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1339/2685] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:02 2022] DELETE /identity/v3/users/61ae8a36b5c945c4993f33a236313d17 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:02.458803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.460299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:02.476820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e131-18b1-46f1-b01b-286e0854074b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.534893 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.536097 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.536526 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.537007 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] PATH_INFO: `/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.538047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ffd1daa3fa44c1a4ac4192511d438b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.540025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.586141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ffd1daa3fa44c1a4ac4192511d438b', 'request_id': 'req-5969ecdb-179c-4d38-a643-88cbf5d4641f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.591488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ffd1daa3fa44c1a4ac4192511d438b', 'request_id': 'req-5969ecdb-179c-4d38-a643-88cbf5d4641f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.599279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ffd1daa3fa44c1a4ac4192511d438b', 'request_id': 'req-5969ecdb-179c-4d38-a643-88cbf5d4641f'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.610857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] The token cache is being invalidate because project 54ffd1daa3fa44c1a4ac4192511d438b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:02.611141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.611782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-5969ecdb-179c-4d38-a643-88cbf5d4641f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:02.613326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1347/2686] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:02 2022] DELETE /identity/v3/projects/54ffd1daa3fa44c1a4ac4192511d438b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:02.619909 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.620204 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.620495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.640000 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:02.641193 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:02.699238 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1340/2687] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:02.707853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.708182 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.708511 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.728468 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:02.729707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:02.738885 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1348/2688] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:02.743554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.753802 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70670af6-477f-4a1d-8b2f-a60c746ca293 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.759469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.760123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.760400 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.760668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.761408 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:02.761709 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.763352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.775412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1341/2689] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:02.781149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.795493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70acbc-fec8-4e63-8dc9-3c7d00389796 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.803973 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.804708 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.805226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.805226 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.806077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.808421 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.833706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1349/2690] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:02 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:02.837867 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.848235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73daf99-afd5-4137-894c-248d98ff265a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.915849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.916514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.916793 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.917065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.917761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.919754 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.944324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1342/2691] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:02 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:02.948707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.959431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b06-884a-467a-8256-cbbb2fbd62d4 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.964594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.965290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:02.965573 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:02.965853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:02.966612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:02.968266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:02.978543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1350/2692] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:02.982763 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:02.992979 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bc14e-1abb-4b9f-807f-7c96e6d9a7d4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:02.999076 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:02.999730 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.000157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.000652 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.001949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.004027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07cd90-1889-4a3b-943b-85ac90de2b68 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.016017 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1343/2693] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:03.020314 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.035367 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990fb8-b13d-4f65-b120-86266253705d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.043753 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.044650 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.044927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.045198 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] PATH_INFO: `/v3/projects/f08b4563425544ce86f771d349898762/users/4bbc0c20e65b4e4a8aa1c89215d8800f/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.061412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08b4563425544ce86f771d349898762, user_id=4bbc0c20e65b4e4a8aa1c89215d8800f, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.064111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.080327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1351/2694] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:03 2022] PUT /identity/v3/projects/f08b4563425544ce86f771d349898762/users/4bbc0c20e65b4e4a8aa1c89215d8800f/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:03.095060 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.095860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.095860 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.127414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] MFA Rules not processed for user `4bbc0c20e65b4e4a8aa1c89215d8800f`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:03.128611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:03.197460 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1344/2695] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:03.202338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.269583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dda0a-9631-417c-9b9e-e50d3a8b2ff3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.276911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.277875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.278161 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.278448 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.279279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.281457 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.310495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1352/2696] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:03.314504 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.325461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b80a21-3dd2-4b93-a5c4-a4d8779ba7f7 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.383633 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.384418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.384771 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.385116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.385964 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.388461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.415596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1345/2697] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:03.419431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.430368 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f812-4e8e-47c7-9e60-7269ddfd7417 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.435431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.436498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.436498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.436724 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.437471 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.439151 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.450127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1353/2698] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:03.454586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.464831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be964ecb-e16f-4846-9b4c-b2ebabbfc729 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.472988 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.473811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.474254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.474254 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.475122 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.476776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b036d-2174-4dcc-95a2-191e1982dcfc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.490635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1346/2699] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:03.492008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.503063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db8e0-a60e-465a-8c3a-4b4d9d115bb5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.508670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.509782 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.510898 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.511350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] PATH_INFO: `/v3/projects/cf8e30679f6744beb85aabf1eb4e2235/users/f5c67383e161486c88736057fd1e841b/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.537662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8e30679f6744beb85aabf1eb4e2235, user_id=f5c67383e161486c88736057fd1e841b, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.540907 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.556596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1354/2700] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:03 2022] PUT /identity/v3/projects/cf8e30679f6744beb85aabf1eb4e2235/users/f5c67383e161486c88736057fd1e841b/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:03.569272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.570054 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.570338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.599111 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] MFA Rules not processed for user `f5c67383e161486c88736057fd1e841b`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:03.600339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:03.675260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1347/2701] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:03.679788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.749004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d0fe-6ddb-4e25-9556-eef43bc4bab7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.753772 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.754435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.754813 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.755091 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.755804 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.757706 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.785333 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1355/2702] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:03.789495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.799980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e17a7-b5fe-442a-8523-7dd5eeaa27fe None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.854252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.854896 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.855196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.855465 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.856246 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.858159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.881391 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1348/2703] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:03 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:03.885624 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.896720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367a179-5b2d-4ec1-9d37-fe7af62168c1 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.901864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.902534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.902849 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.903128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.903949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.905570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.916170 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1356/2704] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:03.920702 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.930586 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc1bb9-b1d9-4fd3-a8c2-cb10f6954dbe admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:03.935621 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:03.936574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:03.936915 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:03.937249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] PATH_INFO: `/v3/projects/21c72dc40e734c919273d44b675aec3c/users/2d4c6021d360458292a577d7fc64cf89/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:03.954239 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c72dc40e734c919273d44b675aec3c, user_id=2d4c6021d360458292a577d7fc64cf89, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:03.957065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:03.971795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1349/2705] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:03 2022] PUT /identity/v3/projects/21c72dc40e734c919273d44b675aec3c/users/2d4c6021d360458292a577d7fc64cf89/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:03.975993 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:03.987656 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd87f4-4b5d-4918-b7bd-3f5fbfcc1107 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:04.046165 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:04.047321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:04.047613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:04.047888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:04.049122 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:04.050791 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481d6c7-f185-4517-9f57-47fb1d346e60 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:04.061258 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1357/2706] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:04.065512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:04.075814 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be977a-7771-41b8-9c38-5980b2650f79 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:04.080677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:04.081556 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:04.081829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:04.082099 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] PATH_INFO: `/v3/projects/21c72dc40e734c919273d44b675aec3c/users/2d4c6021d360458292a577d7fc64cf89/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:04.084139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c72dc40e734c919273d44b675aec3c, user_id=2d4c6021d360458292a577d7fc64cf89, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:04.086780 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:04.096947 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1350/2707] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:04 2022] PUT /identity/v3/projects/21c72dc40e734c919273d44b675aec3c/users/2d4c6021d360458292a577d7fc64cf89/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:04.107535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:04.107742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:04.107984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:04.136369 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] MFA Rules not processed for user `2d4c6021d360458292a577d7fc64cf89`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:04.137613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:04.205980 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1358/2708] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:04.216821 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:04.218584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:04.276429 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d08543-b2ad-48a5-9c35-ddfb01d6afa8 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:04.280435 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:04.281085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:04.281367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:04.281630 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:04.290829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:04.292274 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:04.301705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1351/2709] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:04.344564 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:04.345989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:04.358211 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf45df-1a91-42e7-af1f-df972895b071 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:04.362147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:04.362837 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:04.363125 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:04.363402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:04.418684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:04.420218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e2d8d-e974-4647-9a8c-d04362733f5e service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:04.429695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1359/2710] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:07.405970 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:07.465686 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f52b-2c15-4633-bc50-292217d78539 service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:07.470548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:07.471542 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:07.471898 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:07.472249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] PATH_INFO: `/v3/users/4bbc0c20e65b4e4a8aa1c89215d8800f` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:07.473576 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbc0c20e65b4e4a8aa1c89215d8800f)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:07.475624 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:07.528154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbc0c20e65b4e4a8aa1c89215d8800f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:07.535347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbc0c20e65b4e4a8aa1c89215d8800f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:07.547646 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbc0c20e65b4e4a8aa1c89215d8800f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:07.548441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbc0c20e65b4e4a8aa1c89215d8800f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:07.557712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbc0c20e65b4e4a8aa1c89215d8800f'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:07.565676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1352/2711] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:07 2022] DELETE /identity/v3/users/4bbc0c20e65b4e4a8aa1c89215d8800f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:07.570413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:07.570927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:07.571024 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:07.589853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:07.591140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:07.651223 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1360/2712] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:07.661270 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:07.662744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:07.718696 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123128a-7b09-4018-bc61-1867d1160ad3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:07.722975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:07.723614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:07.723912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:07.724259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:07.734001 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:07.735484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:07.745407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1353/2713] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:07.840080 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:07.851228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486829-1b1e-4a3f-88ef-194eb5691159 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:07.855409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:07.856327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:07.856604 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:07.856904 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:07.859292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:07.931259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:07.932722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:07.943257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1361/2714] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:08.075011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:08.076750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:08.091381 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c8d66-c07d-477a-a9a4-65576ce0b647 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:08.103495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:08.104806 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:08.105407 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:08.106347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] PATH_INFO: `/v3/projects/f08b4563425544ce86f771d349898762` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:08.108020 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08b4563425544ce86f771d349898762)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:08.110259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:08.167514 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08b4563425544ce86f771d349898762', 'request_id': 'req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.172904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08b4563425544ce86f771d349898762', 'request_id': 'req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.181336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08b4563425544ce86f771d349898762', 'request_id': 'req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.199179 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] The token cache is being invalidate because project f08b4563425544ce86f771d349898762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:08.200024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.200954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.205651 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1354/2715] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:08 2022] DELETE /identity/v3/projects/f08b4563425544ce86f771d349898762 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:08.206929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:08.217307 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c16b-a7fd-4062-b83c-6bd7eb72ddff service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:08.276413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:08.277334 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:08.277614 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:08.277894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] PATH_INFO: `/v3/users/f5c67383e161486c88736057fd1e841b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:08.279299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c67383e161486c88736057fd1e841b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:08.281243 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:08.331016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c67383e161486c88736057fd1e841b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.339486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c67383e161486c88736057fd1e841b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.340324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c67383e161486c88736057fd1e841b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.347359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c67383e161486c88736057fd1e841b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.360681 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c67383e161486c88736057fd1e841b'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.367025 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1362/2716] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:08 2022] DELETE /identity/v3/users/f5c67383e161486c88736057fd1e841b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:08.642967 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:08.644628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:08.658591 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51694ac-573a-48b4-9cd8-bf354d4c2ec2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:08.728164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:08.729789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:08.730138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:08.730527 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] PATH_INFO: `/v3/projects/cf8e30679f6744beb85aabf1eb4e2235` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:08.731993 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8e30679f6744beb85aabf1eb4e2235)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:08.733902 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:08.778615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8e30679f6744beb85aabf1eb4e2235', 'request_id': 'req-48403772-0b05-4d0d-8575-e9d2bfbd9c20'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.784028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8e30679f6744beb85aabf1eb4e2235', 'request_id': 'req-48403772-0b05-4d0d-8575-e9d2bfbd9c20'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.791966 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8e30679f6744beb85aabf1eb4e2235', 'request_id': 'req-48403772-0b05-4d0d-8575-e9d2bfbd9c20'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.802885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] The token cache is being invalidate because project cf8e30679f6744beb85aabf1eb4e2235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:08.803173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.803800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.805340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1355/2717] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:08 2022] DELETE /identity/v3/projects/cf8e30679f6744beb85aabf1eb4e2235 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:08.809411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:08.810989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:08.824108 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11d66-f1e2-4e61-838d-cf048f884b8f admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:08.884383 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:08.885521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:08.885803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:08.886071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] PATH_INFO: `/v3/users/2d4c6021d360458292a577d7fc64cf89` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:08.887500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4c6021d360458292a577d7fc64cf89)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:08.889467 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:08.942071 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4c6021d360458292a577d7fc64cf89'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.950963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4c6021d360458292a577d7fc64cf89'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.951598 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4c6021d360458292a577d7fc64cf89'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.959839 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4c6021d360458292a577d7fc64cf89'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.971410 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-fce984b0-2006-4296-86a5-46f5eb5b90bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4c6021d360458292a577d7fc64cf89'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:08.977372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1363/2718] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:08 2022] DELETE /identity/v3/users/2d4c6021d360458292a577d7fc64cf89 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:09.274453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.277010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:09.296607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403772-0b05-4d0d-8575-e9d2bfbd9c20 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.363451 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.364244 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.364523 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.364803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] PATH_INFO: `/v3/projects/21c72dc40e734c919273d44b675aec3c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.366013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c72dc40e734c919273d44b675aec3c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.368325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.413319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c72dc40e734c919273d44b675aec3c', 'request_id': 'req-0f5ba719-3444-4543-bcd7-8a19ab6117c6'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:09.419789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c72dc40e734c919273d44b675aec3c', 'request_id': 'req-0f5ba719-3444-4543-bcd7-8a19ab6117c6'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:09.428133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c72dc40e734c919273d44b675aec3c', 'request_id': 'req-0f5ba719-3444-4543-bcd7-8a19ab6117c6'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:09.439414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] The token cache is being invalidate because project 21c72dc40e734c919273d44b675aec3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:09.439694 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:09.440318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-0f5ba719-3444-4543-bcd7-8a19ab6117c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:09.442133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1356/2719] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:09 2022] DELETE /identity/v3/projects/21c72dc40e734c919273d44b675aec3c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:09.448343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.448732 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.449102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.469134 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:09.470344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:09.530406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1364/2720] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:09.539756 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.540189 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.540436 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.559203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:09.560539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:09.569365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1357/2721] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:09.573770 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.584544 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3e4a-b459-41d3-944a-de4896852410 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.589444 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.590190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.590566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.590935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.591749 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:09.592065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.593683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.607866 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1365/2722] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:09.612748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.629792 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733a520-70a5-4d60-9c11-fcfef9ba7b22 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.634358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.635049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.635331 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.635603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.636311 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.638287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.665599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1358/2723] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:09 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:09.674186 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.684287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f981a4-82be-4b3d-aa21-7424d278b188 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.740695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.741356 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.741629 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.741903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.743006 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.744915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.768901 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1366/2724] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:09.770156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.780525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8503-39e6-4ae1-ad41-c7ca57f0959d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.785282 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.785943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.786226 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.786495 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.787269 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.788871 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.799376 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1359/2725] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:09.803492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.813685 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e42e5-ec0a-4da7-a04d-b221ce03da88 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.818460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.819149 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.819458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.819730 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.820852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.822054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1be4a-fcb8-4e1c-bbe7-ace1b05220a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.832235 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1367/2726] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:09.836412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:09.846549 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345230a-b252-42e2-ae48-7ae51b260a66 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:09.851333 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:09.852223 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.852503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.852779 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] PATH_INFO: `/v3/projects/6d973f1ea13d43daa55ee34ee10983de/users/78965e49977a4c88ba83f16eb9e1c7bc/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.867765 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d973f1ea13d43daa55ee34ee10983de, user_id=78965e49977a4c88ba83f16eb9e1c7bc, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:09.870421 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:09.884538 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1360/2727] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:09 2022] PUT /identity/v3/projects/6d973f1ea13d43daa55ee34ee10983de/users/78965e49977a4c88ba83f16eb9e1c7bc/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:09.898829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:09.899158 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:09.899442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:09.940460 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] MFA Rules not processed for user `78965e49977a4c88ba83f16eb9e1c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:09.941683 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:10.018875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1368/2728] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:10.031082 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:10.032822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:10.092721 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340a3-749a-40cf-bc85-92e8539fa866 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:10.096428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12399215913a4d619dc6be7f0c037347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:10.097077 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:10.097503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:10.097882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:10.107035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:10.108537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:10.118064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1361/2729] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:10.448033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:10.450337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:10.530205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4a1c6-8ab8-426b-93d0-483aa16036bb None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:10.534747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:10.535606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:10.536035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:10.536477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:10.538747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:10.644603 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:10.645991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:10.666081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1369/2730] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:44:14.036705 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.038319 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:14.060075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddda742-c74e-438e-aba1-8a4d52bf90b4 service glance] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.065318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.066257 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.066597 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.066984 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] PATH_INFO: `/v3/users/d637094d14264332b6a947fe1e5c0ad8` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.068426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d637094d14264332b6a947fe1e5c0ad8)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.071075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.123085 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd637094d14264332b6a947fe1e5c0ad8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.130599 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd637094d14264332b6a947fe1e5c0ad8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.142488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd637094d14264332b6a947fe1e5c0ad8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.143344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd637094d14264332b6a947fe1e5c0ad8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.151747 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5e398326-e2d1-40d1-9b99-5115936f1ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd637094d14264332b6a947fe1e5c0ad8'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.158314 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1362/2731] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:14 2022] DELETE /identity/v3/users/d637094d14264332b6a947fe1e5c0ad8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:14.341286 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.360935 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314088-16dd-4d2f-aca5-bcd5c20c0dff service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.416675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.417549 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.417824 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.418107 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] PATH_INFO: `/v3/projects/50e1249fa4204bf9ba3044c3c1260634` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.419350 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e1249fa4204bf9ba3044c3c1260634)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.421268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.468765 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e1249fa4204bf9ba3044c3c1260634', 'request_id': 'req-75ff5ad4-6f6b-4da7-a239-1a54eb331959'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.474855 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e1249fa4204bf9ba3044c3c1260634', 'request_id': 'req-75ff5ad4-6f6b-4da7-a239-1a54eb331959'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.484190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e1249fa4204bf9ba3044c3c1260634', 'request_id': 'req-75ff5ad4-6f6b-4da7-a239-1a54eb331959'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.496529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] The token cache is being invalidate because project 50e1249fa4204bf9ba3044c3c1260634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:14.496815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.497597 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-75ff5ad4-6f6b-4da7-a239-1a54eb331959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:14.499392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1370/2732] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:14 2022] DELETE /identity/v3/projects/50e1249fa4204bf9ba3044c3c1260634 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:14.507267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.507738 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.508192 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.534975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:14.536178 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:14.606444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1363/2733] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:14.614608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.614922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.615192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.635694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:14.636802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:14.646175 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1371/2734] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:14.650537 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.661100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd9af9-3ea3-4d1b-ae06-680c51d06d17 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.666844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.667548 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.667884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.668127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.668941 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:14.669263 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.671065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.684379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1364/2735] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:14.689056 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.698582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399592ef-f73a-4bca-b2b0-466dbe023c63 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.703943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.704600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.705018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.705205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.706001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.708272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.738150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1372/2736] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:14 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:14.742948 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.752938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6802b-e11d-43e4-85bc-033fe4dae1c4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.809866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.810560 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.810882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.811186 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.811899 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.813958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.835469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1365/2737] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:14 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:14.839636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.850274 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a31a3-e3a9-4d0a-ad52-945921137b59 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.858593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.858593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.858593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.858593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.859096 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.859810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.874862 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1373/2738] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:14.879044 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.889334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922f3b-ba1d-4622-95f1-1b45dac7142e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.894138 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.894829 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.895116 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.895394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.896133 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.897741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf368f-5123-4e9c-9d96-627da6c18b3b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.907475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1366/2739] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:14.911621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:14.922105 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91e217-5305-4fab-aea5-6fd72568cf22 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:14.927659 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:14.928579 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.928861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.929135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] PATH_INFO: `/v3/projects/6556d1d6a974405587dee25346074318/users/477810b3d4b748ffb39f289f1f2b8ad9/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:14.943519 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6556d1d6a974405587dee25346074318, user_id=477810b3d4b748ffb39f289f1f2b8ad9, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:14.946159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:14.961892 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1374/2740] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:14 2022] PUT /identity/v3/projects/6556d1d6a974405587dee25346074318/users/477810b3d4b748ffb39f289f1f2b8ad9/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:14.973288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:14.973579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:14.973870 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:15.001872 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] MFA Rules not processed for user `477810b3d4b748ffb39f289f1f2b8ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:15.003145 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:15.070464 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1367/2741] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:15.081864 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:15.084090 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:15.164841 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1243-6f51-48e5-ade2-1f0e030b143c admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:15.171875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:15.172534 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:15.172846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:15.173120 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:15.181634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:15.183297 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5602c4e-3218-48d4-8c3d-668d06e00e99 service nova] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:15.192547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1375/2742] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:17.881943 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:17.956107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb269f-6200-45b5-88e3-eddb8f4da5ca None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:17.961647 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:17.962531 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:17.962836 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:17.963107 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] PATH_INFO: `/v3/users/477810b3d4b748ffb39f289f1f2b8ad9` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:17.964440 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477810b3d4b748ffb39f289f1f2b8ad9)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:17.966434 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.027562 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477810b3d4b748ffb39f289f1f2b8ad9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.035218 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477810b3d4b748ffb39f289f1f2b8ad9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.046643 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477810b3d4b748ffb39f289f1f2b8ad9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.047397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477810b3d4b748ffb39f289f1f2b8ad9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.055796 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477810b3d4b748ffb39f289f1f2b8ad9'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.063448 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1368/2743] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:17 2022] DELETE /identity/v3/users/477810b3d4b748ffb39f289f1f2b8ad9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:18.068437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.068955 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.069059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.085500 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:18.086694 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:18.147093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1376/2744] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:18.156982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.158991 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:18.220119 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a084-0e5b-4d9f-a97c-254739911068 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:18.224316 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:18.225147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.225430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.225707 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.236463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:18.237911 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630777ef-da3c-44fc-860f-8a2cbe3fd503 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.248129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1369/2745] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:18.525961 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.527530 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:18.539989 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c32e-dfe3-4cb1-966e-113d4a14ddf4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:18.545991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:18.547022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.547331 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.547663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] PATH_INFO: `/v3/projects/6556d1d6a974405587dee25346074318` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.549179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6556d1d6a974405587dee25346074318)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:18.551697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.603696 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6556d1d6a974405587dee25346074318', 'request_id': 'req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.609580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6556d1d6a974405587dee25346074318', 'request_id': 'req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.618486 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6556d1d6a974405587dee25346074318', 'request_id': 'req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.632834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] The token cache is being invalidate because project 6556d1d6a974405587dee25346074318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:18.633132 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.634030 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-0792b734-9100-4cd4-ae57-cc0c2a5cd4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:18.635956 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1377/2746] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:18 2022] DELETE /identity/v3/projects/6556d1d6a974405587dee25346074318 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:18.642364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.642668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.643066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.670347 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:18.672010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:18.735025 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1370/2747] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:18.743484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.743775 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.744051 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.762881 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:18.764082 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:18.772326 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1378/2748] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:18.777094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.789835 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9279-c91f-479f-b9e1-3356f6099b9f None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:18.795399 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:18.796049 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.796329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.796661 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.797449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:18.797751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:18.799449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.812454 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1371/2749] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:18.817130 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.826559 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94224f11-be5c-4b01-93e0-31a0298b20e0 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:18.832299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:18.832952 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.833231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.833498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.834197 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:18.836145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.867779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1379/2750] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:18 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:18.872613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.883981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd767e-787d-40dd-811a-9543e56a7d37 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:18.950681 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:18.951368 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:18.951645 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:18.951914 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:18.952603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:18.954498 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:18.976575 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1372/2751] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:18 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:18.981442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:18.998127 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0b5-c3cf-4cc7-bf42-06f6b719f73a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.005779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.006445 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.006760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.007036 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.007776 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.009386 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.020018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1380/2752] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:19.024083 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.034242 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dd6f-10f9-4f4f-b83b-d267e3312c4b admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.039923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.040600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.040878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.041156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.041928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.043572 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79ce3-7a92-40f7-94af-c9ac8715e6cd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.059823 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1373/2753] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:19.060366 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.071585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddf5a-09d4-433a-a617-7a94ebdd5e94 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.076417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.077377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.077720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.078052 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] PATH_INFO: `/v3/projects/52c9177859db4442ba75c608c2941011/users/08691deb409f4644adfd6e3602f7ae4e/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.092916 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c9177859db4442ba75c608c2941011, user_id=08691deb409f4644adfd6e3602f7ae4e, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.095635 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.110859 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1381/2754] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:19 2022] PUT /identity/v3/projects/52c9177859db4442ba75c608c2941011/users/08691deb409f4644adfd6e3602f7ae4e/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:19.121746 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.122030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.122302 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.148798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] MFA Rules not processed for user `08691deb409f4644adfd6e3602f7ae4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:19.149985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:19.219410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1374/2755] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:19.224218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.290933 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e63be8-f87b-40e1-8ef8-4b53603388e0 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.296284 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.296927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.297246 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.297502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.298201 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.300159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.328536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1382/2756] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:19 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:19.333002 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.344171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22fcb1-d8e4-43d6-be49-791573b812a8 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.402712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.403423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.403735 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.404006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.404725 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.406667 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.431053 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1375/2757] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:19 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:19.435347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.445948 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd286b-8bf2-4906-a898-f1a6c8b1fc48 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.450966 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.451655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.451942 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.452349 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.453145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.454790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.469529 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1383/2758] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:19.470853 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.481176 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298b8b3-df0f-43ae-8647-89d9b5771e7e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.485931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.486858 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.487142 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.487417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] PATH_INFO: `/v3/projects/0d3501fd2ff54822906b1b6b323fc104/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.503949 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3501fd2ff54822906b1b6b323fc104, user_id=1d681c4bc6fe4cbd8ebcac16a10d4ab7, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.506676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.521759 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1376/2759] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:19 2022] PUT /identity/v3/projects/0d3501fd2ff54822906b1b6b323fc104/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:19.525949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.537078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fcd19-1305-45bb-a239-4b8ae5229c79 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.607412 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.608244 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.608663 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.608949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.609768 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.611606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f39df1-20ee-45f7-a355-acd0e6c5b410 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.623076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1384/2760] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:19.627418 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.638404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba99f-2470-48eb-905e-102a8f991bb7 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.643516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.644594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.644934 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.645267 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] PATH_INFO: `/v3/projects/0d3501fd2ff54822906b1b6b323fc104/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.647414 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3501fd2ff54822906b1b6b323fc104, user_id=1d681c4bc6fe4cbd8ebcac16a10d4ab7, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.650139 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.662094 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1377/2761] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:19 2022] PUT /identity/v3/projects/0d3501fd2ff54822906b1b6b323fc104/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:19.674063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.674342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.674631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.703584 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] MFA Rules not processed for user `1d681c4bc6fe4cbd8ebcac16a10d4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:19.704830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:19.788324 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1385/2762] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:19.798719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:19.801221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:19.860063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5ac5d-8797-4045-b37a-d9e43089022f admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:19.864447 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:19.865113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:19.865388 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:19.865669 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:19.875711 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:19.877158 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8deeb-c385-4dca-a7ea-395278b1c45e service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:19.888517 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1378/2763] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:44:20.052483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:20.116354 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b158db-0333-40ef-a99a-a84cdba58a50 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:20.121874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:20.122868 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:20.123217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:20.123552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] PATH_INFO: `/v3/users/08691deb409f4644adfd6e3602f7ae4e` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:20.124825 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08691deb409f4644adfd6e3602f7ae4e)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:20.127319 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:20.178378 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08691deb409f4644adfd6e3602f7ae4e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.186303 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08691deb409f4644adfd6e3602f7ae4e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.186962 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08691deb409f4644adfd6e3602f7ae4e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.193755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08691deb409f4644adfd6e3602f7ae4e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.204953 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08691deb409f4644adfd6e3602f7ae4e'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.211416 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1386/2764] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:20 2022] DELETE /identity/v3/users/08691deb409f4644adfd6e3602f7ae4e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:20.216144 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:20.216506 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:20.216963 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:20.235776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:20.238063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:20.301300 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1379/2765] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:20.336397 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:20.337943 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:20.398385 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02652562-635c-41ff-9aac-b79a5dbd2773 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:20.402887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:20.403535 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:20.403815 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:20.404111 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:20.414085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:20.415595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:20.425387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1387/2766] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:20.691852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:20.693486 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:20.705211 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30164c1d-415d-4059-9f06-9f5dc44cc25a None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:20.710805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:20.711703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:20.711974 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:20.712235 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] PATH_INFO: `/v3/projects/52c9177859db4442ba75c608c2941011` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:20.713413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c9177859db4442ba75c608c2941011)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:20.715425 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:20.761956 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c9177859db4442ba75c608c2941011', 'request_id': 'req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.770005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c9177859db4442ba75c608c2941011', 'request_id': 'req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.777452 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c9177859db4442ba75c608c2941011', 'request_id': 'req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.788396 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] The token cache is being invalidate because project 52c9177859db4442ba75c608c2941011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:20.788684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.789379 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.791028 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1380/2767] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:20 2022] DELETE /identity/v3/projects/52c9177859db4442ba75c608c2941011 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:20.795040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:20.804930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877b6f8-b80d-4557-b422-9ea053e2f5b9 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:20.864473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:20.865353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:20.865608 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:20.865903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] PATH_INFO: `/v3/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:20.867651 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d681c4bc6fe4cbd8ebcac16a10d4ab7)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:20.869626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:20.918300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d681c4bc6fe4cbd8ebcac16a10d4ab7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.926026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d681c4bc6fe4cbd8ebcac16a10d4ab7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.926755 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d681c4bc6fe4cbd8ebcac16a10d4ab7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.933835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d681c4bc6fe4cbd8ebcac16a10d4ab7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.945408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7519eb7c-eb5b-44d6-b44e-f4189425d8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d681c4bc6fe4cbd8ebcac16a10d4ab7'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:20.951765 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1388/2768] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:20 2022] DELETE /identity/v3/users/1d681c4bc6fe4cbd8ebcac16a10d4ab7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:21.216755 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.218194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:21.231986 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6ce5-8a3e-4c4b-a6a2-60542dcb85cf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.289494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.290369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.290635 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.290951 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] PATH_INFO: `/v3/projects/0d3501fd2ff54822906b1b6b323fc104` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.292118 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3501fd2ff54822906b1b6b323fc104)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.294056 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.340093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3501fd2ff54822906b1b6b323fc104', 'request_id': 'req-2986c957-5cce-403a-ab1e-70663f8f30db'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:21.345908 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3501fd2ff54822906b1b6b323fc104', 'request_id': 'req-2986c957-5cce-403a-ab1e-70663f8f30db'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:21.354444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3501fd2ff54822906b1b6b323fc104', 'request_id': 'req-2986c957-5cce-403a-ab1e-70663f8f30db'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:21.365334 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] The token cache is being invalidate because project 0d3501fd2ff54822906b1b6b323fc104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:21.365631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:21.366249 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-2986c957-5cce-403a-ab1e-70663f8f30db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:21.368164 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1381/2769] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:21 2022] DELETE /identity/v3/projects/0d3501fd2ff54822906b1b6b323fc104 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:21.374040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.374570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.374570 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.392897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:21.394145 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:21.464675 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1389/2770] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:21.472525 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.472781 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.473063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.492885 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:21.494081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:21.503472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1382/2771] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:21.507725 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.518039 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9263-f1c0-4183-b642-847cc7d35f45 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.523660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.524338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.524640 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.524913 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.525655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:21.525965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.527611 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.539375 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1390/2772] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:21.543507 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.552752 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b34cf7-a91e-4b5f-893e-d7aad97fb630 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.557838 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.558484 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.558800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.559070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.559774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.561699 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.588785 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1383/2773] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:21.592946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.603022 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b2a29-4934-464e-816b-01910d3ee9b3 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.658900 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.659585 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.659843 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.660137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.660861 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.662852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.685810 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1391/2774] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:21.689992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.700335 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb585-54a9-4b6a-94ac-39b6544d81c9 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.705502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.706190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.706564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.706877 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.707674 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.709427 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.720288 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1384/2775] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:21.724232 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.735047 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc0910-f727-4b3a-9ed6-e5b58c9d830a admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.740850 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.741503 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.741805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.742442 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.743362 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.744978 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c514c-66be-4b82-b97e-3b97f49db1f3 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.755018 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1392/2776] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:21.759175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.768992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29eabb-67da-4951-b266-fc997309d6a5 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:21.774203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:21.775089 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.775365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.775628 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] PATH_INFO: `/v3/projects/b5ca527a678c4f3991f0a9bc25e17cf6/users/c3bf2aa974b0467f94c0ef97b3c06fe3/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.793741 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ca527a678c4f3991f0a9bc25e17cf6, user_id=c3bf2aa974b0467f94c0ef97b3c06fe3, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:21.798033 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:21.816574 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1385/2777] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:21 2022] PUT /identity/v3/projects/b5ca527a678c4f3991f0a9bc25e17cf6/users/c3bf2aa974b0467f94c0ef97b3c06fe3/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:21.827321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:21.827610 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:21.827927 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:21.856381 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] MFA Rules not processed for user `c3bf2aa974b0467f94c0ef97b3c06fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:21.857600 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:21.926054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1393/2778] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:21.931328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:21.997415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a498d1-3d38-468f-8f01-d9464096b283 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.002809 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.003564 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.003849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.004123 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.004824 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.006828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.033845 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1386/2779] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:21 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:22.038065 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.049135 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681b61-9940-41df-bc0a-dffb0dcde1e1 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.109477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.110156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.110447 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.110742 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.111466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.113458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.136964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1394/2780] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:22 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:22.141774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.155415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b1d4-eb98-4d81-a65f-492754d917ae admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.163822 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.164751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.165121 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.165449 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.166394 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.168816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.181932 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1387/2781] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:44:22.186159 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.196338 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3347f8-61ff-43a9-90c1-9ea665caf83d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.201669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.202566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.202873 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.203141 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] PATH_INFO: `/v3/projects/ab464c53814c46b3869e06ebc661437b/users/08d5e59bde544a4ca722edba93542600/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.218805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab464c53814c46b3869e06ebc661437b, user_id=08d5e59bde544a4ca722edba93542600, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.221601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.237067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1395/2782] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:22 2022] PUT /identity/v3/projects/ab464c53814c46b3869e06ebc661437b/users/08d5e59bde544a4ca722edba93542600/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:22.241363 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.251982 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386fa3f-1442-47d0-8889-d3921c0f9a7c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.307065 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.307708 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.308009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.308278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.309013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.310623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe73710-b178-46a5-9645-1cbaaddaf2c8 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.321328 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1388/2783] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:22.325720 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.336596 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6791d4e-17ce-498c-9be2-5f22b6d4abb7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.342187 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.343109 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.343392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.343666 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] PATH_INFO: `/v3/projects/ab464c53814c46b3869e06ebc661437b/users/08d5e59bde544a4ca722edba93542600/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.345777 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab464c53814c46b3869e06ebc661437b, user_id=08d5e59bde544a4ca722edba93542600, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.348521 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.358746 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1396/2784] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:22 2022] PUT /identity/v3/projects/ab464c53814c46b3869e06ebc661437b/users/08d5e59bde544a4ca722edba93542600/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:22.370352 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.370637 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.370942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.398103 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] MFA Rules not processed for user `08d5e59bde544a4ca722edba93542600`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:22.399327 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:22.609050 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1389/2785] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:22.622296 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.625377 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:22.687882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833bc0a-faae-43dd-873a-05b05c123a4e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.691491 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.692143 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.692420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.692695 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.701492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.703010 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.713077 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1397/2786] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:22.761841 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:22.763423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:22.776658 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce46a2-3049-4d5c-b350-bcc4d883bdf7 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:22.780611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:22.781247 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:22.781528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:22.781799 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:22.839844 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:22.841265 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3f39-0943-4ec1-bd7d-ad04860bd905 service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:22.852127 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1390/2787] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:26.090064 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:26.156023 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5479c-0bdb-4eb9-acc3-3b7f33160620 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:26.160964 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:26.161842 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.162114 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.162384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] PATH_INFO: `/v3/users/c3bf2aa974b0467f94c0ef97b3c06fe3` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.163612 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bf2aa974b0467f94c0ef97b3c06fe3)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:26.165543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:26.217255 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bf2aa974b0467f94c0ef97b3c06fe3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.227370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bf2aa974b0467f94c0ef97b3c06fe3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.228043 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bf2aa974b0467f94c0ef97b3c06fe3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.236795 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bf2aa974b0467f94c0ef97b3c06fe3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.253054 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bf2aa974b0467f94c0ef97b3c06fe3'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.259189 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1398/2788] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:26 2022] DELETE /identity/v3/users/c3bf2aa974b0467f94c0ef97b3c06fe3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:26.265843 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.266397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.266397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.293463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:26.294903 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.365284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1391/2789] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:26.375692 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:26.377295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.578698 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc15524-823b-4128-bc02-044d091f4238 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:26.583492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:26.584131 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.584408 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.584677 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.594489 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:26.595965 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dacfa-4dde-4b07-b6b5-4b6fa937d44d service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:26.607392 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1399/2790] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:26.749156 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:26.751035 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.763030 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57a2ba-d7d9-4b22-94d5-e22e0b0225ef None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:26.768827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:26.769678 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.769900 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.770196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] PATH_INFO: `/v3/users/78965e49977a4c88ba83f16eb9e1c7bc` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.771453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=78965e49977a4c88ba83f16eb9e1c7bc)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:26.773390 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:26.822159 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78965e49977a4c88ba83f16eb9e1c7bc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.828848 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78965e49977a4c88ba83f16eb9e1c7bc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.840453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78965e49977a4c88ba83f16eb9e1c7bc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.841217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78965e49977a4c88ba83f16eb9e1c7bc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.849354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78965e49977a4c88ba83f16eb9e1c7bc'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:26.855847 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1392/2791] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:26 2022] DELETE /identity/v3/users/78965e49977a4c88ba83f16eb9e1c7bc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:26.860481 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.860834 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.861115 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.879063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:26.880278 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.900992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:26.902480 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.941897 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1400/2792] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:26.951869 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:26.953318 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:26.971375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9b362-64a7-433b-9643-6cf346d57beb admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:26.977426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:26.978644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:26.979087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:26.979992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] PATH_INFO: `/v3/projects/b5ca527a678c4f3991f0a9bc25e17cf6` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:26.981494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ca527a678c4f3991f0a9bc25e17cf6)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:26.983834 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.008736 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cf20f-b1be-4a82-a8d5-8e4b5dfc2616 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.012344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.012991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.013281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.013536 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.024514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.026495 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.032428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ca527a678c4f3991f0a9bc25e17cf6', 'request_id': 'req-4f57813f-2374-45fe-baec-367ca66fc21c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.037252 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1401/2793] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:44:27.038479 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ca527a678c4f3991f0a9bc25e17cf6', 'request_id': 'req-4f57813f-2374-45fe-baec-367ca66fc21c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.048217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ca527a678c4f3991f0a9bc25e17cf6', 'request_id': 'req-4f57813f-2374-45fe-baec-367ca66fc21c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.060113 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] The token cache is being invalidate because project b5ca527a678c4f3991f0a9bc25e17cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:27.060477 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.061131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.062719 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1393/2794] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:26 2022] DELETE /identity/v3/projects/b5ca527a678c4f3991f0a9bc25e17cf6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:27.066899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.076702 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68c7e-4421-438d-86da-0246c806d76c service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.134011 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.134922 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.135203 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.135644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] PATH_INFO: `/v3/users/08d5e59bde544a4ca722edba93542600` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.136875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d5e59bde544a4ca722edba93542600)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.138811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.185435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d5e59bde544a4ca722edba93542600'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.194124 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d5e59bde544a4ca722edba93542600'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.194828 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d5e59bde544a4ca722edba93542600'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.201788 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d5e59bde544a4ca722edba93542600'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.213218 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d5e59bde544a4ca722edba93542600'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.219016 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1402/2795] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:27 2022] DELETE /identity/v3/users/08d5e59bde544a4ca722edba93542600 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:27.321626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.324023 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.337466 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57813f-2374-45fe-baec-367ca66fc21c admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.404716 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.405584 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.405862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.406129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] PATH_INFO: `/v3/projects/6d973f1ea13d43daa55ee34ee10983de` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.407325 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d973f1ea13d43daa55ee34ee10983de)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.409214 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.454075 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d973f1ea13d43daa55ee34ee10983de', 'request_id': 'req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.459373 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d973f1ea13d43daa55ee34ee10983de', 'request_id': 'req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.467171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d973f1ea13d43daa55ee34ee10983de', 'request_id': 'req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.479129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] The token cache is being invalidate because project 6d973f1ea13d43daa55ee34ee10983de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:27.479382 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.480172 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-bdc8c536-4bdf-40ef-a072-e8ecf2f4c45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.482184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1394/2796] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:27 2022] DELETE /identity/v3/projects/6d973f1ea13d43daa55ee34ee10983de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:27.487687 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.489290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.492580 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482f26-2360-4123-a636-dafc3f2b9a9d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.493015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482f26-2360-4123-a636-dafc3f2b9a9d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.493370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482f26-2360-4123-a636-dafc3f2b9a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.502889 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a5790-aebb-47f9-9447-32074db2f8dd admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.516882 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-1f482f26-2360-4123-a636-dafc3f2b9a9d None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:27.518259 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-1f482f26-2360-4123-a636-dafc3f2b9a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.558589 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.559483 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.559763 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.560037 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] PATH_INFO: `/v3/projects/ab464c53814c46b3869e06ebc661437b` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.561234 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab464c53814c46b3869e06ebc661437b)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.563214 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.574006 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1395/2797] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:27.582207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.582494 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.582815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.602441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:27.603631 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.610155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab464c53814c46b3869e06ebc661437b', 'request_id': 'req-f26e49a9-b149-4cfb-87db-5490815cbc94'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.615741 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab464c53814c46b3869e06ebc661437b', 'request_id': 'req-f26e49a9-b149-4cfb-87db-5490815cbc94'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.623062 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab464c53814c46b3869e06ebc661437b', 'request_id': 'req-f26e49a9-b149-4cfb-87db-5490815cbc94'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.633820 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] The token cache is being invalidate because project ab464c53814c46b3869e06ebc661437b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:27.634155 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.634806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-f26e49a9-b149-4cfb-87db-5490815cbc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:27.636574 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1403/2798] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:27 2022] DELETE /identity/v3/projects/ab464c53814c46b3869e06ebc661437b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:27.641101 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5db4-1215-4da1-99a1-ff37d1da3664 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.641384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5db4-1215-4da1-99a1-ff37d1da3664 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.641657 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5db4-1215-4da1-99a1-ff37d1da3664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.659353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-c03d5db4-1215-4da1-99a1-ff37d1da3664 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:27.660578 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c03d5db4-1215-4da1-99a1-ff37d1da3664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.662380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1396/2799] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:27.666607 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.668856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1404/2800] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:27.675989 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b5530-283d-4df2-97d4-324fe0a5bef2 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.676427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.676715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.676991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.680614 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.681262 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.681540 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.681810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.682539 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:27.682873 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.684566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.695562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:27.696155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1397/2801] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 10 03:44:27.696748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:27.700546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.705092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1405/2802] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:27.709963 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.710322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b2e0-9ffe-4f7a-9d37-9e96abcd8308 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.715011 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.715676 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.715945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.716198 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] PATH_INFO: `/v3/projects` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.716889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.718811 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.719432 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381d42-ab59-4c36-b7ea-782bdbf6202a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.724396 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.725066 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.725347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.725619 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] PATH_INFO: `/v3/domains` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.726373 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:27.726856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.728492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.740347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1406/2803] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:27.745029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.746775 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1398/2804] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:27.750980 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.755085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88967f17-8b80-406c-9468-ad05c006e990 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.808907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7eb3-fc8f-4841-a5e8-756bb24e9740 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.809121 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.809707 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.809984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.810253 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.810979 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.812882 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.813615 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.814273 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.814552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.814849 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.815544 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.817600 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.841594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1399/2805] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:27.841822 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1407/2806] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:27.842364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.842563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.851532 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e36c0-6acc-4117-bfb1-ea1db9a00782 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.900325 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba898-e94e-4733-a720-37719fa049b2 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.904227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.904895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.905026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.905173 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.905443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.905747 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.906026 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.906180 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.906285 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.907000 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.907810 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.908877 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.917649 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1400/2807] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:44:27.921789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.931929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1408/2808] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:27 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:27.932097 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad459d-bc27-401c-bd97-b6781004194a admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.933085 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.935761 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.936410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.936687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.936958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.937684 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.939297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.942761 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25efd6-3781-47ac-8c9e-f34e492c9fe6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.948033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.948679 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.949037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1401/2809] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:44:27.949167 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.949272 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.949929 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.951660 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.952878 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.961906 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1409/2810] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:27.962644 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289784-e017-4531-b6f4-872dd187a2f6 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.965785 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:27.967921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.968776 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.969055 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.969323 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] PATH_INFO: `/v3/projects/55d5968b6c2c488484c4fe1dcffb4346/users/51fb0d32bf99412493c439a748c294dd/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.974853 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c02df2-8890-4c1e-8204-c188704c5b29 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:27.979348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:27.979984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:27.980267 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:27.980539 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:27.981302 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.982852 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.984561 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d5968b6c2c488484c4fe1dcffb4346, user_id=51fb0d32bf99412493c439a748c294dd, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:27.987321 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710df5-6dd3-402f-860a-3db63f154ef5 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:27.993190 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1410/2811] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:44:27.997670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.002626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1402/2812] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:27 2022] PUT /identity/v3/projects/55d5968b6c2c488484c4fe1dcffb4346/users/51fb0d32bf99412493c439a748c294dd/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:28.007662 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68955d7-52f2-44d4-82e4-dc4a085314b6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.012945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.013227 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.013493 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.039673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] MFA Rules not processed for user `51fb0d32bf99412493c439a748c294dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:28.040884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:28.061744 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.062644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.062946 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.063217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] PATH_INFO: `/v3/projects/401c1bacddeb42a6b0f8c87cdf220f48/users/359bb03c1e1b4eff89143b13d1481159/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.077886 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401c1bacddeb42a6b0f8c87cdf220f48, user_id=359bb03c1e1b4eff89143b13d1481159, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.080541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bddbe-af33-42d9-9a33-754e75b007a7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.094794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1411/2813] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:27 2022] PUT /identity/v3/projects/401c1bacddeb42a6b0f8c87cdf220f48/users/359bb03c1e1b4eff89143b13d1481159/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:28.104207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1403/2814] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:28.105480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.105762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.106128 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.112166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.113816 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:28.132562 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] MFA Rules not processed for user `359bb03c1e1b4eff89143b13d1481159`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:28.133740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:28.168469 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f946e67-e94d-4599-b9b0-7ddfc6881234 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.194488 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1412/2815] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:28.199740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.216602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.217252 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.217528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.217797 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.260553 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63db8-5098-48e8-8358-580f5814a8af None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.265321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087135-82d9-429f-835f-822184cc802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.265981 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087135-82d9-429f-835f-822184cc802b admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.266263 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087135-82d9-429f-835f-822184cc802b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.266543 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087135-82d9-429f-835f-822184cc802b admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.267348 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11087135-82d9-429f-835f-822184cc802b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.269266 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11087135-82d9-429f-835f-822184cc802b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.269938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.271404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.280231 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1404/2816] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:44:28.294726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1413/2817] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:28 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:28.298805 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.309348 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a02e-50f5-4271-a136-9e5fdd5f640b service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.361937 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.362596 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.362856 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.363196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.364010 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.365913 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.387061 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1405/2818] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:28 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:28.391308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087135-82d9-429f-835f-822184cc802b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.402514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087135-82d9-429f-835f-822184cc802b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.407671 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.408413 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.408764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.409059 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.409789 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.411458 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.422811 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1414/2819] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:28.427221 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.436958 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be63e4-1ea6-4543-a9cc-c639f4c27fcf admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.442266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.443190 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.443468 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.443740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] PATH_INFO: `/v3/projects/52792c32ee3443839b94267d30ecab2a/users/658e52b74d964638904c6fa659904628/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.459389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52792c32ee3443839b94267d30ecab2a, user_id=658e52b74d964638904c6fa659904628, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.462153 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.478307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1406/2820] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:28 2022] PUT /identity/v3/projects/52792c32ee3443839b94267d30ecab2a/users/658e52b74d964638904c6fa659904628/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:28.482806 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.493802 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068f68-13c2-43b0-a5f1-b6088d4a452d admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.553493 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.554178 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.554459 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.554759 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.555502 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.557089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b71b4a-9bea-4de7-b0d1-cb874316782b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.568295 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1415/2821] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:28.572526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.582837 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb71a7-4352-4e94-aeff-de8471ba05e4 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.587326 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.588343 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] REQUEST_METHOD: `PUT` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.588602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.589015 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] PATH_INFO: `/v3/projects/52792c32ee3443839b94267d30ecab2a/users/658e52b74d964638904c6fa659904628/roles/e90a5aca8c9c4ad88b3a04e367493007` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.591171 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52792c32ee3443839b94267d30ecab2a, user_id=658e52b74d964638904c6fa659904628, role_id=e90a5aca8c9c4ad88b3a04e367493007)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.593917 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.604182 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1407/2822] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:28 2022] PUT /identity/v3/projects/52792c32ee3443839b94267d30ecab2a/users/658e52b74d964638904c6fa659904628/roles/e90a5aca8c9c4ad88b3a04e367493007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:44:28.615591 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.615894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.616276 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.642594 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] MFA Rules not processed for user `658e52b74d964638904c6fa659904628`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:28.643817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:28.713484 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1416/2823] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:28.725185 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.781250 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56753d-d262-4ea3-b74b-9af55bc0dadc admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.785475 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.786137 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.786415 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.786698 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.796245 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.797677 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.807197 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1408/2824] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:28.850537 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:28.852207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:28.865417 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e1cb2-7a06-4992-b1e6-d90b2a940249 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:28.870225 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:28.870894 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:28.871176 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:28.871451 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:28.936004 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:28.937435 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5302-9793-4691-8506-e946b782f9a3 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:28.946174 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1417/2825] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:33.446583 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:33.507622 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf846-4654-4101-a4b7-d09e6ef45b0c service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:33.513203 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:33.514102 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:33.514375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:33.514640 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] PATH_INFO: `/v3/users/359bb03c1e1b4eff89143b13d1481159` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:33.516058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359bb03c1e1b4eff89143b13d1481159)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:33.518012 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:33.565157 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359bb03c1e1b4eff89143b13d1481159'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:33.571777 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359bb03c1e1b4eff89143b13d1481159'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:33.583606 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359bb03c1e1b4eff89143b13d1481159'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:33.584413 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359bb03c1e1b4eff89143b13d1481159'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:33.593067 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359bb03c1e1b4eff89143b13d1481159'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:33.599292 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1409/2826] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:33 2022] DELETE /identity/v3/users/359bb03c1e1b4eff89143b13d1481159 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:33.603974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:33.604477 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:33.604602 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:33.622547 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:33.623773 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:33.683469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1418/2827] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:33.693554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:33.695098 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:33.751322 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3e3a-2488-4858-88c7-ce4084bc5885 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:33.755513 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:33.756155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:33.756458 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:33.756700 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:33.766336 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:33.767813 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:33.777369 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1410/2828] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:34.049684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.051308 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:34.066474 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776768c0-d330-4718-826c-dce19a8aaae5 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:34.071641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:34.072525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.072856 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.073137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] PATH_INFO: `/v3/projects/401c1bacddeb42a6b0f8c87cdf220f48` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.074414 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401c1bacddeb42a6b0f8c87cdf220f48)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:34.076409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:34.125400 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401c1bacddeb42a6b0f8c87cdf220f48', 'request_id': 'req-c639f34b-a55f-4f45-a631-6d6107cebeb6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.130644 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401c1bacddeb42a6b0f8c87cdf220f48', 'request_id': 'req-c639f34b-a55f-4f45-a631-6d6107cebeb6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.138863 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401c1bacddeb42a6b0f8c87cdf220f48', 'request_id': 'req-c639f34b-a55f-4f45-a631-6d6107cebeb6'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.151903 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] The token cache is being invalidate because project 401c1bacddeb42a6b0f8c87cdf220f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:34.152220 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.152931 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.154555 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1419/2829] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:34 2022] DELETE /identity/v3/projects/401c1bacddeb42a6b0f8c87cdf220f48 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:34.158886 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.168536 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8162a1-4638-41ba-a655-4021c8d80b93 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:34.227070 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:34.227875 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.228147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.228417 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] PATH_INFO: `/v3/users/658e52b74d964638904c6fa659904628` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.229751 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658e52b74d964638904c6fa659904628)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:34.231744 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:34.281219 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658e52b74d964638904c6fa659904628'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.288800 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658e52b74d964638904c6fa659904628'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.302324 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658e52b74d964638904c6fa659904628'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.303037 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658e52b74d964638904c6fa659904628'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.311749 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5d575136-a127-4d98-827d-baa7db733c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658e52b74d964638904c6fa659904628'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.317688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1411/2830] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:34 2022] DELETE /identity/v3/users/658e52b74d964638904c6fa659904628 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:34.592552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.594231 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:34.608033 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f34b-a55f-4f45-a631-6d6107cebeb6 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:34.666075 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:34.666992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.667268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.667542 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] PATH_INFO: `/v3/projects/52792c32ee3443839b94267d30ecab2a` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.668760 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52792c32ee3443839b94267d30ecab2a)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:34.670693 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:34.720514 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52792c32ee3443839b94267d30ecab2a', 'request_id': 'req-8c4d200d-74e6-432a-8425-2ac9d3c74e41'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.726680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52792c32ee3443839b94267d30ecab2a', 'request_id': 'req-8c4d200d-74e6-432a-8425-2ac9d3c74e41'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.737032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52792c32ee3443839b94267d30ecab2a', 'request_id': 'req-8c4d200d-74e6-432a-8425-2ac9d3c74e41'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.748812 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] The token cache is being invalidate because project 52792c32ee3443839b94267d30ecab2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:34.749093 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.749829 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-8c4d200d-74e6-432a-8425-2ac9d3c74e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:34.751525 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1420/2831] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:34 2022] DELETE /identity/v3/projects/52792c32ee3443839b94267d30ecab2a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:34.757975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.758482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.758579 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.779831 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:34.780938 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:34.856078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1412/2832] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:34.864871 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.865185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.865466 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.885237 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:34.886437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:34.896086 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1421/2833] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:34.900546 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.910687 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184e14-a33d-47ae-9dbd-e0b622eb1f43 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:34.916419 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:34.917078 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.917353 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.917627 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.918364 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:34.918685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:34.920313 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:34.932066 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1413/2834] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:34.936321 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.945793 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7eb0-8d56-4b41-a562-eb2d0172d55a None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:34.951401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:34.952058 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:34.952337 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:34.952609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:34.953300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:34.955268 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:34.983647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1422/2835] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:34.987921 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:34.999768 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a61f-8abd-4705-bd83-96323c62b270 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.059526 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.060194 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.060473 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.060717 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.061461 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.063428 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.084895 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1414/2836] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:34 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:35.089142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:35.099805 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b1-7786-4c61-b29b-174421d6ba2e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.104647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.105300 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.105577 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.105888 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.106670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.108240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.119636 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1423/2837] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:35.123714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:35.133727 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687769-09f9-4cfc-91ce-aca8bf4d96a3 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.138618 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.139307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.139588 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.139866 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.140603 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.142201 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248a43-0e64-426f-835f-ddec38963b93 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.152005 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1415/2838] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 10 03:44:35.156061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:35.166342 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb595a-5539-43d5-9156-0983d684aae7 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.172150 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.173032 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.173311 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.173582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] PATH_INFO: `/v3/projects/22639f7a23924fff8f53fbd1b52ed292/users/b95c4b323fad4526a6fdfd227be19c8c/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.188874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22639f7a23924fff8f53fbd1b52ed292, user_id=b95c4b323fad4526a6fdfd227be19c8c, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.191588 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.211353 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1424/2839] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:35 2022] PUT /identity/v3/projects/22639f7a23924fff8f53fbd1b52ed292/users/b95c4b323fad4526a6fdfd227be19c8c/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:35.227481 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.227766 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.228043 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.254058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] MFA Rules not processed for user `b95c4b323fad4526a6fdfd227be19c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:35.255344 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:35.329169 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1416/2840] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:35.339147 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:35.341166 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:35.400876 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597acf0c-5057-4225-82a9-d673841d1f9b admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.405372 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.406015 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.406347 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.406622 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.415575 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.417001 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532d10e-76ab-44c5-bc1b-d4906772218f service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.425726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1425/2841] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:35.904665 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:35.906441 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:35.921412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961b91-eaaf-475e-b2af-1f9f4182e89d None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:35.926423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:35.927342 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:35.927619 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:35.927889 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:35.929726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:35.986268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:35.987726 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:35.997021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1417/2842] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:45.951162 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bba1-32b2-4295-8eb9-397737f2c14a None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:45.951718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bba1-32b2-4295-8eb9-397737f2c14a None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:45.951718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bba1-32b2-4295-8eb9-397737f2c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:45.968465 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-faa0bba1-32b2-4295-8eb9-397737f2c14a None None] MFA Rules not processed for user `1521bf93314c437798ef374963def38e`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:45.973713 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-faa0bba1-32b2-4295-8eb9-397737f2c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:45.982669 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1426/2843] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:48.554045 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:48.555613 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:48.653375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164e5b-52b2-4b15-9164-6d782db4115d service cinder] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:48.659592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:48.660739 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:48.661472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:48.662084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] PATH_INFO: `/v3/users/51fb0d32bf99412493c439a748c294dd` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:48.663923 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51fb0d32bf99412493c439a748c294dd)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:48.667380 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:48.725554 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51fb0d32bf99412493c439a748c294dd'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:48.732942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51fb0d32bf99412493c439a748c294dd'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:48.745423 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51fb0d32bf99412493c439a748c294dd'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:48.746152 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51fb0d32bf99412493c439a748c294dd'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:48.757175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51fb0d32bf99412493c439a748c294dd'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:48.765365 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1418/2844] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:48 2022] DELETE /identity/v3/users/51fb0d32bf99412493c439a748c294dd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:48.769846 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:48.770409 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:48.770580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:48.791427 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:48.793035 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:48.857865 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1427/2845] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:48.870685 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:48.872147 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:48.927234 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bee53-33c2-4f4d-aa5e-61b19af8551e admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:48.931154 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:48.931815 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:48.932093 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:48.932378 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:48.941786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:48.943406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:48.955833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1419/2846] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:49.414830 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:49.416988 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:49.449976 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7060f4-c6d9-43d8-af34-12a2ad44c3e4 None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:49.456089 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:49.457241 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:49.457700 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:49.458137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] PATH_INFO: `/v3/projects/55d5968b6c2c488484c4fe1dcffb4346` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:49.459609 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d5968b6c2c488484c4fe1dcffb4346)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:49.462505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:49.515887 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d5968b6c2c488484c4fe1dcffb4346', 'request_id': 'req-7083e53a-4d24-4fe0-8c10-a26233b07629'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:49.522726 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d5968b6c2c488484c4fe1dcffb4346', 'request_id': 'req-7083e53a-4d24-4fe0-8c10-a26233b07629'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:49.532344 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d5968b6c2c488484c4fe1dcffb4346', 'request_id': 'req-7083e53a-4d24-4fe0-8c10-a26233b07629'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:49.545014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] The token cache is being invalidate because project 55d5968b6c2c488484c4fe1dcffb4346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:49.545299 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:49.545939 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7083e53a-4d24-4fe0-8c10-a26233b07629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:49.547606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1428/2847] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:49 2022] DELETE /identity/v3/projects/55d5968b6c2c488484c4fe1dcffb4346 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:51.443693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:51.445155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:51.459430 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a8977-e761-4aa6-9a1a-effb2ba0de08 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:51.517611 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:51.518482 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:51.518790 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:51.519058 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] PATH_INFO: `/v3/users/b95c4b323fad4526a6fdfd227be19c8c` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:51.520266 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95c4b323fad4526a6fdfd227be19c8c)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:51.522162 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:51.567308 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95c4b323fad4526a6fdfd227be19c8c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:51.573862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95c4b323fad4526a6fdfd227be19c8c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:51.585534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95c4b323fad4526a6fdfd227be19c8c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:51.586312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95c4b323fad4526a6fdfd227be19c8c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:51.594084 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95c4b323fad4526a6fdfd227be19c8c'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:51.600463 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1420/2848] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:44:51 2022] DELETE /identity/v3/users/b95c4b323fad4526a6fdfd227be19c8c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:51.605327 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:51.605819 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:51.605936 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:51.624403 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:51.625618 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:51.687014 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1429/2849] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:51.697074 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:51.698795 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:51.760952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f81-c786-4fd3-a5f7-d64426d29e14 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:51.768318 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:51.769312 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:51.769689 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:51.770009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:51.781444 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:51.782928 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d5775-eb40-4869-9727-3bc058d636ab service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:51.792503 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1421/2850] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:52.068292 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.069803 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:52.081476 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d909ca-6db1-4e1e-9d5f-af0ff5c9490b None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.086206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.087112 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.087393 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.087664 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] PATH_INFO: `/v3/projects/22639f7a23924fff8f53fbd1b52ed292` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.088858 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=22639f7a23924fff8f53fbd1b52ed292)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.090778 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.137279 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22639f7a23924fff8f53fbd1b52ed292', 'request_id': 'req-910e0f9b-2d36-49c7-aaf7-222acc9115aa'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:52.142340 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22639f7a23924fff8f53fbd1b52ed292', 'request_id': 'req-910e0f9b-2d36-49c7-aaf7-222acc9115aa'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:52.151593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22639f7a23924fff8f53fbd1b52ed292', 'request_id': 'req-910e0f9b-2d36-49c7-aaf7-222acc9115aa'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:52.162485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] The token cache is being invalidate because project 22639f7a23924fff8f53fbd1b52ed292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:44:52.162808 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:52.163485 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-910e0f9b-2d36-49c7-aaf7-222acc9115aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:44:52.165179 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1430/2851] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:44:52 2022] DELETE /identity/v3/projects/22639f7a23924fff8f53fbd1b52ed292 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:52.170287 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.170566 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.170862 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.189021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:52.190258 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:52.251985 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1422/2852] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 10 03:44:52.260384 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.260697 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.260975 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.279654 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.auth.core [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:52.280851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:52.289401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1431/2853] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:52.295100 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.304833 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea706b-f4fb-438e-aad4-155b3794c047 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.311024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.311673 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.311952 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.312209 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] PATH_INFO: `/v3/domains` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.312954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 10 03:44:52.313268 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.314905 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.326852 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1423/2854] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Feb 10 03:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 10 03:44:52.331420 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.341634 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627fc2-42e8-49a9-8608-585eb2535ccd None None] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.347092 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.347718 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] REQUEST_METHOD: `POST` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.347997 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.348275 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.348982 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.351063 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.380992 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1432/2855] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Feb 10 03:44:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 10 03:44:52.385443 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.400626 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2e5a2-1fad-41bd-b143-c4dee14fa806 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.459715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.460397 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.460668 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.460942 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] PATH_INFO: `/v3/users` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.461639 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.463695 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.485587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1424/2856] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Feb 10 03:44:52 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 10 03:44:52.489987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.500826 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1181a-b90c-4b80-bfac-e6c241804a15 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.505639 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.506290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.506567 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.506872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.507607 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.509185 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.519370 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1433/2857] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:52.523370 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.533682 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3519b8-31f5-42c3-9ba2-fd12d180e471 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.538770 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.539426 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.539714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.539972 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.540714 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.542305 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561957f4-7d14-4e5b-88df-2cefb246dfdd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.552052 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1425/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Feb 10 03:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 10 03:44:52.556779 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.572293 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd271-92df-424c-9312-6d8e56de56ed admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.581257 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.582552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.582990 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.583345 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] PATH_INFO: `/v3/projects/971e4963ecd649e8ba5e72ebfc30318a/users/8869eb0bfb7c44e9ba3fb095a00b9e05/roles/9af319ef09aa4cd69445115653b41037` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.599431 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=971e4963ecd649e8ba5e72ebfc30318a, user_id=8869eb0bfb7c44e9ba3fb095a00b9e05, role_id=9af319ef09aa4cd69445115653b41037)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.602078 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.617298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1434/2859] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Feb 10 03:44:52 2022] PUT /identity/v3/projects/971e4963ecd649e8ba5e72ebfc30318a/users/8869eb0bfb7c44e9ba3fb095a00b9e05/roles/9af319ef09aa4cd69445115653b41037 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:44:52.622774 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b984-ddc7-4725-8da3-02bb028ccb96 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.623063 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b984-ddc7-4725-8da3-02bb028ccb96 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.623340 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b984-ddc7-4725-8da3-02bb028ccb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.641945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-fcb7b984-ddc7-4725-8da3-02bb028ccb96 None None] MFA Rules not processed for user `203b86d4b17b44b7b8c725bbce8d9578`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:52.643329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-fcb7b984-ddc7-4725-8da3-02bb028ccb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:52.702487 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1426/2860] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:52.713262 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:52.715464 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:52.773040 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c222b-637e-421a-b10e-cfe7761185fb admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:52.776818 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:52.777498 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:52.777783 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:52.778061 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:52.787984 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:52.789424 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:52.798991 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1435/2861] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:53.403160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035a2c-b175-4e70-aa0f-bbf3bcb89a7a None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:53.403557 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035a2c-b175-4e70-aa0f-bbf3bcb89a7a None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:53.403933 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035a2c-b175-4e70-aa0f-bbf3bcb89a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:53.431789 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-f5035a2c-b175-4e70-aa0f-bbf3bcb89a7a None None] MFA Rules not processed for user `8869eb0bfb7c44e9ba3fb095a00b9e05`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:53.433367 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-f5035a2c-b175-4e70-aa0f-bbf3bcb89a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:53.501018 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1427/2862] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:53.511298 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:53.512740 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:53.569722 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a5aa-3f92-4688-9212-205ac5bede60 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:53.573833 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ef495cf58846848130382884d739e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:53.574520 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:53.574827 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:53.575160 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:53.584142 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:53.585601 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:53.594817 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1436/2863] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:44:54.947710 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:54.948778 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:54.949114 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:54.976594 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] MFA Rules not processed for user `8869eb0bfb7c44e9ba3fb095a00b9e05`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:44:54.977954 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:54.988431 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1428/2864] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:44:55.280213 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:44:55.281748 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:55.295044 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cec94d-7e4c-4667-ade6-a0c4e2a108a7 service cinder] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:44:55.299648 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:44:55.300287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:44:55.300566 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:44:55.300840 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:44:55.302875 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:44:55.313251 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:44:55.314684 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:44:55.323087 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1437/2865] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:44:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:45:02.527693 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:45:02.538412 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1e987-54e5-4a43-a4c5-61f7379cecf0 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:45:02.542890 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:45:02.543528 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:45:02.543803 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:45:02.544064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:45:02.546048 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:45:02.609891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:45:02.611358 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99458a-f997-4a6d-b17c-dbbb03e79ed3 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:45:02.621703 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1429/2866] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:45:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:45:48.449332 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:45:48.450947 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:45:48.533076 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030194aa-17d6-4605-9b39-b3f45b932cd3 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:45:48.538631 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:45:48.539287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:45:48.539593 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:45:48.539872 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:45:48.541851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:45:48.553359 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:45:48.555055 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:45:48.564715 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1438/2867] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:45:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:45:59.205552 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] REQUEST_METHOD: `POST` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:45:59.206081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:45:59.206081 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:45:59.224184 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.auth.core [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] MFA Rules not processed for user `8869eb0bfb7c44e9ba3fb095a00b9e05`. Rule list: `[]` (Enabled: `True`). {{(pid=79148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 10 03:45:59.225420 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:45:59.233671 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1430/2868] 10.222.0.32 () {58 vars in 957 bytes} [Thu Feb 10 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 10 03:46:37.338193 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:46:37.348490 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29201-2d95-4180-bdb8-8298b9b9f77e service placement] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:46:37.352606 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:46:37.353287 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:46:37.353571 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:46:37.353851 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:46:37.355949 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:46:37.367921 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:46:37.369411 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:46:37.379247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1439/2869] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:46:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:46:37.464196 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:46:37.475297 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bcff0-74e7-44b6-bba3-ea78e2b4ab68 None None] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:46:37.479748 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:46:37.480438 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:46:37.480712 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:46:37.481151 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:46:37.483130 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:46:37.558904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:46:37.560501 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:46:37.572675 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1431/2870] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:46:59.225580 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:46:59.234690 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f117a5-52af-4298-b3d9-df55bd26c14f service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:46:59.238954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:46:59.239592 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:46:59.240228 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:46:59.240492 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:46:59.242407 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:46:59.255192 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:46:59.256595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:46:59.266282 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1440/2871] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:46:59.974935 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:46:59.990488 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043937cf-a52a-4964-ad97-324b0dca89ca service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:46:59.995309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:46:59.996277 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:46:59.996788 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:46:59.996981 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] PATH_INFO: `/v3/users/8869eb0bfb7c44e9ba3fb095a00b9e05` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:46:59.998232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8869eb0bfb7c44e9ba3fb095a00b9e05)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:00.000175 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:00.048424 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8869eb0bfb7c44e9ba3fb095a00b9e05'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.055404 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8869eb0bfb7c44e9ba3fb095a00b9e05'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.066750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8869eb0bfb7c44e9ba3fb095a00b9e05'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.067453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8869eb0bfb7c44e9ba3fb095a00b9e05'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.076166 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8869eb0bfb7c44e9ba3fb095a00b9e05'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.082232 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1432/2872] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:46:59 2022] DELETE /identity/v3/users/8869eb0bfb7c44e9ba3fb095a00b9e05 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:47:00.257322 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:47:00.267672 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd566-46ba-41ac-9970-34806ec5f56f service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:47:00.322756 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:47:00.323655 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:47:00.323954 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:47:00.324207 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] PATH_INFO: `/v3/projects/971e4963ecd649e8ba5e72ebfc30318a` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:47:00.325440 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971e4963ecd649e8ba5e72ebfc30318a)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:00.327398 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:00.374670 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971e4963ecd649e8ba5e72ebfc30318a', 'request_id': 'req-b19225f9-e2f2-48f0-86fa-08b10492cb90'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.380473 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971e4963ecd649e8ba5e72ebfc30318a', 'request_id': 'req-b19225f9-e2f2-48f0-86fa-08b10492cb90'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.387247 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971e4963ecd649e8ba5e72ebfc30318a', 'request_id': 'req-b19225f9-e2f2-48f0-86fa-08b10492cb90'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.398550 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] The token cache is being invalidate because project 971e4963ecd649e8ba5e72ebfc30318a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:47:00.398878 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.399506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:00.401144 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1441/2873] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:47:00 2022] DELETE /identity/v3/projects/971e4963ecd649e8ba5e72ebfc30318a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:47:05.868275 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:47:05.870688 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:47:05.885027 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefad84-4014-481c-a8cd-ac311b28cadd admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:47:05.941743 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:47:05.942636 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:47:05.942946 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:47:05.943220 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] PATH_INFO: `/v3/users/1521bf93314c437798ef374963def38e` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:47:05.944406 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1521bf93314c437798ef374963def38e)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:05.946375 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:05.994222 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1521bf93314c437798ef374963def38e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.002206 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1521bf93314c437798ef374963def38e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.014272 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1521bf93314c437798ef374963def38e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.015013 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1521bf93314c437798ef374963def38e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.023850 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1521bf93314c437798ef374963def38e'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.029769 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1433/2874] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:47:05 2022] DELETE /identity/v3/users/1521bf93314c437798ef374963def38e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:47:06.216762 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:47:06.218343 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:47:06.233390 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19225f9-e2f2-48f0-86fa-08b10492cb90 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:47:06.292987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:47:06.293857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:47:06.294136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:47:06.294406 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] PATH_INFO: `/v3/projects/9861d9e039084b9b9b24721464eea6e6` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:47:06.295647 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9861d9e039084b9b9b24721464eea6e6)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:06.297572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:06.343081 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9861d9e039084b9b9b24721464eea6e6', 'request_id': 'req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.348794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9861d9e039084b9b9b24721464eea6e6', 'request_id': 'req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.357137 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9861d9e039084b9b9b24721464eea6e6', 'request_id': 'req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.369572 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] The token cache is being invalidate because project 9861d9e039084b9b9b24721464eea6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:47:06.370027 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.370739 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.372469 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1442/2875] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:47:06 2022] DELETE /identity/v3/projects/9861d9e039084b9b9b24721464eea6e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:47:06.376502 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:47:06.377912 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:47:06.390907 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adf3db-3208-4a2a-9adc-8ddb8e0a6c97 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:47:06.445623 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:47:06.446518 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:47:06.446828 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:47:06.447101 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] PATH_INFO: `/v3/users/314fce21a15547469fb2b0141d7b6c65` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:47:06.448309 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314fce21a15547469fb2b0141d7b6c65)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:06.450217 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:06.498329 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314fce21a15547469fb2b0141d7b6c65'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.507338 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314fce21a15547469fb2b0141d7b6c65'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.521057 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314fce21a15547469fb2b0141d7b6c65'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.521740 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314fce21a15547469fb2b0141d7b6c65'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.530996 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314fce21a15547469fb2b0141d7b6c65'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.537260 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1434/2876] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:47:06 2022] DELETE /identity/v3/users/314fce21a15547469fb2b0141d7b6c65 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:47:06.715541 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:47:06.717119 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:47:06.735506 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc8e9-eaa1-4c7a-977e-1bba5865e9c5 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:47:06.794930 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:47:06.795794 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:47:06.796069 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:47:06.796339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] PATH_INFO: `/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:47:06.797552 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b2abbdf50e43459596d5941eaaa4c6)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:47:06.799480 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:47:06.845148 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b2abbdf50e43459596d5941eaaa4c6', 'request_id': 'req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.850613 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b2abbdf50e43459596d5941eaaa4c6', 'request_id': 'req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.859281 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b2abbdf50e43459596d5941eaaa4c6', 'request_id': 'req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.871153 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] The token cache is being invalidate because project e2b2abbdf50e43459596d5941eaaa4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:47:06.871437 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.872067 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:47:06.873583 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1443/2877] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:47:06 2022] DELETE /identity/v3/projects/e2b2abbdf50e43459596d5941eaaa4c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:48:09.775936 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:09.778087 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:09.855931 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5f89-c567-434e-9698-d104e75341e2 admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:09.926798 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:09.927472 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:09.927750 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:09.928134 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:09.929975 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:09.942516 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:09.944307 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:09.948920 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:09.950505 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:09.957131 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1435/2878] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:48:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:48:10.007387 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780c1b-4f05-489c-a0a4-c1adc1c3d027 admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:10.011240 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:10.011891 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:10.012177 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:10.012441 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:10.014206 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:10.028217 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:10.030434 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:10.042945 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:10.044356 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:10.050848 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1444/2879] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:48:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:48:10.056442 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2e1c-eb75-4807-8cd2-415975cb161f service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:10.059602 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:10.060256 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:10.060534 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:10.060807 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:10.062592 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:10.072859 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:10.074199 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:10.083230 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1436/2880] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:48:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 10 03:48:11.228156 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:11.237195 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f74c-c7a6-4362-95d5-48c61d3d5200 service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:11.241874 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f0955fb6d7347afb65d3acec567eb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:11.242523 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:11.242835 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:11.243110 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:11.244987 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:11.259364 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:11.260911 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:11.272508 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1445/2881] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:48:12.164884 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:12.167051 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:12.184715 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efbe7-23c1-478d-b93b-d6de069ab7c3 service neutron] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:12.190904 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6cf5d4bba4126a0a94a4db29dee52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:12.191587 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] REQUEST_METHOD: `GET` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:12.191863 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:12.192129 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:12.194021 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:12.206278 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:12.208009 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:12.219155 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1437/2882] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:48:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 10 03:48:20.377857 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:20.379429 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:20.445595 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5882-43bd-45a6-8fbf-8bcd956bddab service neutron] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:20.450102 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:20.451028 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:20.451306 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:20.451582 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] PATH_INFO: `/v3/users/87291059637f46ca8985768611d1acf5` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:20.452764 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=87291059637f46ca8985768611d1acf5)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:20.454699 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:20.503974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87291059637f46ca8985768611d1acf5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.513236 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87291059637f46ca8985768611d1acf5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.513934 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87291059637f46ca8985768611d1acf5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.521070 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87291059637f46ca8985768611d1acf5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.532401 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87291059637f46ca8985768611d1acf5'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.538799 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1446/2883] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:48:20 2022] DELETE /identity/v3/users/87291059637f46ca8985768611d1acf5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:48:20.730086 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:20.742207 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edc29-2201-44fe-adb4-1548586c1618 service nova] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:20.800354 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:20.801160 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:20.801453 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:20.801736 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] PATH_INFO: `/v3/projects/69a1b85d278c49969a6a638dd37579d6` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:20.802955 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a1b85d278c49969a6a638dd37579d6)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:20.804869 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:20.861229 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a1b85d278c49969a6a638dd37579d6', 'request_id': 'req-e218d954-73da-47d1-bbc7-006b98112e5d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.868389 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a1b85d278c49969a6a638dd37579d6', 'request_id': 'req-e218d954-73da-47d1-bbc7-006b98112e5d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.879925 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a1b85d278c49969a6a638dd37579d6', 'request_id': 'req-e218d954-73da-47d1-bbc7-006b98112e5d'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.896654 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] The token cache is being invalidate because project 69a1b85d278c49969a6a638dd37579d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:48:20.896976 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.897757 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:20.899339 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1438/2884] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:48:20 2022] DELETE /identity/v3/projects/69a1b85d278c49969a6a638dd37579d6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 10 03:48:20.903974 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:20.905621 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:20.919259 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84337a30-56ec-4b1f-ab34-28ce07aa3dca admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:20.973140 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:20.974008 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:20.974290 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:20.974563 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] PATH_INFO: `/v3/users/68cdb49e1d644975be7acd2319c82020` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:20.975790 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cdb49e1d644975be7acd2319c82020)` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:20.977711 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:21.027205 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cdb49e1d644975be7acd2319c82020'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.035402 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cdb49e1d644975be7acd2319c82020'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.036029 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cdb49e1d644975be7acd2319c82020'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.042680 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cdb49e1d644975be7acd2319c82020'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.054136 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.notifications [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cdb49e1d644975be7acd2319c82020'} {{(pid=79147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.059899 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1447/2885] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Feb 10 03:48:20 2022] DELETE /identity/v3/users/68cdb49e1d644975be7acd2319c82020 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:48:21.240284 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Authenticating user token {{(pid=79148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:48:21.241804 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.fernet_utils [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:48:21.254891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d954-73da-47d1-bbc7-006b98112e5d admin admin] Validating token access rules against request {{(pid=79148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:48:21.312512 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '203b86d4b17b44b7b8c725bbce8d9578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8de7cdc6a1fd4e2da360f0670fd57a70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:48:21.313280 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:48:21.313559 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:48:21.313827 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] PATH_INFO: `/v3/projects/6153f4fd9e97416e818a483c91e5e9c5` {{(pid=79148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:48:21.315064 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6153f4fd9e97416e818a483c91e5e9c5)` {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:48:21.316992 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] RBAC: Authorization granted {{(pid=79148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:48:21.362529 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6153f4fd9e97416e818a483c91e5e9c5', 'request_id': 'req-60b7ece9-a842-479b-9d71-cf795294d5fb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.368024 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6153f4fd9e97416e818a483c91e5e9c5', 'request_id': 'req-60b7ece9-a842-479b-9d71-cf795294d5fb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.376410 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6153f4fd9e97416e818a483c91e5e9c5', 'request_id': 'req-60b7ece9-a842-479b-9d71-cf795294d5fb'} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.387891 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] The token cache is being invalidate because project 6153f4fd9e97416e818a483c91e5e9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 10 03:48:21.388174 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.388786 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: DEBUG keystone.notifications [None req-60b7ece9-a842-479b-9d71-cf795294d5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 10 03:48:21.390293 dv-cinder-828060-2-iscsi devstack@keystone.service[79148]: [pid: 79148|app: 0|req: 1439/2886] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Feb 10 03:48:21 2022] DELETE /identity/v3/projects/6153f4fd9e97416e818a483c91e5e9c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 10 03:51:37.712339 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Authenticating user token {{(pid=79147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 10 03:51:37.714532 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:51:37.869723 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5458e-8108-4a23-8309-5f767b452e4e admin admin] Validating token access rules against request {{(pid=79147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 10 03:51:37.932798 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d2d4a5e36d4d39909faf4bf065f3e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bead2b0a002b4d28b6aeb573040adb08', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 10 03:51:37.933329 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] REQUEST_METHOD: `GET` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 10 03:51:37.933641 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] SCRIPT_NAME: `/identity` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 10 03:51:37.933915 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 10 03:51:37.936019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.fernet_utils [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 10 03:51:37.948053 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 10 03:51:37.949626 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5fed-1864-4939-b47e-cbe912582504 service placement] RBAC: Authorization granted {{(pid=79147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 10 03:51:37.960019 dv-cinder-828060-2-iscsi devstack@keystone.service[79147]: [pid: 79147|app: 0|req: 1448/2887] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Feb 10 03:51:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)